Struct LlmResponse Context

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmResponseContext {
    pub codec: LlmCodecIdentity,
    /* private fields */
}

Response codec context for one non-streaming LLM execution intercept invocation.

Fields

codec: LlmCodecIdentity

Identity of the active response codec.

Implementations

impl LlmResponseContext

impl LlmResponseContext

resolve_codec

pub fn resolve_codec(&self) -> Option<&LlmExecutionResponseCodec>

Resolve the active response codec capability.