Struct LlmResponse Context
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
pub struct LlmResponseContext {
pub codec: LlmCodecIdentity,
/* private fields */
}
Response codec context for one non-streaming LLM execution intercept invocation.
Fields
codec: LlmCodecIdentity
Identity of the active response codec.
Implementations
impl LlmResponseContext
impl LlmResponseContext
resolve_codec
pub fn resolve_codec(&self) -> Option<&LlmExecutionResponseCodec>
Resolve the active response codec capability.