ReferenceAPIsRust Library Referencenemo-relay-worker

Struct LlmExecution Context

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmExecutionContext { /* private fields */ }

Invocation-scoped codec identities and operations for an LLM execution interceptor.

This context identifies the codecs selected when Relay created the managed invocation. Rewriting a request into another provider’s wire format does not change these identities; codec operations reject incompatible payloads.

Implementations

impl LlmExecutionContext

impl LlmExecutionContext

request_codec

pub fn request_codec(&self) -> &LlmRequestContext

Request codec identity and invocation-scoped operations.

response_codec

pub fn response_codec(&self) -> Option<&LlmResponseContext>

Unary response codec identity and invocation-scoped decode operation.

Streaming execution returns None because Relay response codecs decode completed provider responses, not individual stream chunks.

Trait Implementations

impl Clone for LlmExecutionContext

impl Clone for LlmExecutionContext

clone

fn clone(&self) -> LlmExecutionContext

clone_from

fn clone_from(&mut self, source: &Self)

impl Debug for LlmExecutionContext

impl Debug for LlmExecutionContext

fmt

fn fmt(&self, formatter: &mut Formatter<'_>) -> Result