Struct LlmRequest Intercept Outcome

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmRequestInterceptOutcome {
    pub request: Option<LlmRequest>,
    pub annotated_request: Option<Box<AnnotatedLlmRequest>>,
    pub pending_marks: Vec<PendingMarkSpec>,
    pub optimization_contributions: Vec<LlmOptimizationContribution>,
}

Rewritten request, optional authoritative annotation, pending marks, and evidence.

Fields

`request: Option<LlmRequest>`

Rewritten provider request when no request codec is active. With an active request codec, callbacks can change headers but must leave content unchanged. Change the provider body through annotated_request instead.

`annotated_request: Option<Box<AnnotatedLlmRequest>>`

Normalized request annotation to carry forward. An active request codec requires this value and uses it as the source of provider content. Without a request codec, the annotation is optional.

`pending_marks: Vec<PendingMarkSpec>`

Ordered marks to emit after Relay creates and starts the LLM scope.

`optimization_contributions: Vec<LlmOptimizationContribution>`

Ordered plugin-neutral optimization evidence for this LLM call.

Trait Implementations

`impl Clone for LlmRequestInterceptOutcome`

impl Clone for LlmRequestInterceptOutcome

`clone`

fn clone(&self) -> LlmRequestInterceptOutcome

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for LlmRequestInterceptOutcome`

impl Debug for LlmRequestInterceptOutcome

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl Default for LlmRequestInterceptOutcome`

impl Default for LlmRequestInterceptOutcome

`default`

fn default() -> Self

`impl Message for LlmRequestInterceptOutcome`

impl Message for LlmRequestInterceptOutcome

`encoded_len`

fn encoded_len(&self) -> usize

`clear`

fn clear(&mut self)

`encode`

fn encode(&self, buf: &mut impl BufMut) -> Result<(), EncodeError>where
    Self: Sized,

`encode_to_vec`

fn encode_to_vec(&self) -> Vec<u8> where
    Self: Sized,

`encode_length_delimited`

fn encode_length_delimited(
    &self,
    buf: &mut impl BufMut,
) -> Result<(), EncodeError>where
    Self: Sized,

`encode_length_delimited_to_vec`

fn encode_length_delimited_to_vec(&self) -> Vec<u8> where
    Self: Sized,

`decode`

fn decode(buf: impl Buf) -> Result<Self, DecodeError>where
    Self: Default,

`decode_length_delimited`

fn decode_length_delimited(buf: impl Buf) -> Result<Self, DecodeError>where
    Self: Default,

`merge`

fn merge(&mut self, buf: impl Buf) -> Result<(), DecodeError>where
    Self: Sized,

`merge_length_delimited`

fn merge_length_delimited(&mut self, buf: impl Buf) -> Result<(), DecodeError>where
    Self: Sized,

`impl Name for LlmRequestInterceptOutcome`

impl Name for LlmRequestInterceptOutcome

`NAME`

const NAME: &'static str = "LlmRequestInterceptOutcome"

`PACKAGE`

const PACKAGE: &'static str = "nvidia.nemo.relay.worker.v1"

`full_name`

fn full_name() -> String

`type_url`

fn type_url() -> String

`impl PartialEq for LlmRequestInterceptOutcome`

impl PartialEq for LlmRequestInterceptOutcome

`eq`

fn eq(&self, other: &LlmRequestInterceptOutcome) -> bool

`ne`

fn ne(&self, other: &Rhs) -> bool

`impl WireValue<LlmRequestInterceptOutcome> for LlmRequestInterceptOutcome`

impl WireValue<LlmRequestInterceptOutcome> for LlmRequestInterceptOutcome

`to_wire`

fn to_wire(self) -> Result<LlmRequestInterceptOutcome>

`from_wire`

fn from_wire(value: LlmRequestInterceptOutcome) -> Result<Self>

`impl StructuralPartialEq for LlmRequestInterceptOutcome`

impl StructuralPartialEq for LlmRequestInterceptOutcome