ReferenceAPIsRust Library Referencenemo-relay-plugin

Struct LlmExecution Context

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmExecutionContext { /* private fields */ }

Per-call codec context delivered to an LLM execution intercept.

Request codec context is always available. Non-streaming execution also supplies a response codec context, while streaming execution leaves it unavailable until Relay has a completed-response streaming codec contract.

Implementations

impl LlmExecutionContext

impl LlmExecutionContext

request_codec

pub fn request_codec(&self) -> &LlmRequestContext

Return the active request codec context.

response_codec

pub fn response_codec(&self) -> Option<&LlmResponseContext>

Return the completed-response codec context, or None for streaming execution.