Struct LlmExecution Response Codec

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmExecutionResponseCodec { /* private fields */ }

Response codec for one non-streaming LLM execution intercept.

Implementations

`impl LlmExecutionResponseCodec`

impl LlmExecutionResponseCodec

`decode`

pub fn decode(&self, response: &Json) -> Result<AnnotatedLlmResponse>

Decode an opaque response into Relay’s normalized response model.

Trait Implementations

`impl Drop for LlmExecutionResponseCodec`

impl Drop for LlmExecutionResponseCodec

`drop`

fn drop(&mut self)

`impl Send for LlmExecutionResponseCodec`

impl Send for LlmExecutionResponseCodec

`impl Sync for LlmExecutionResponseCodec`

impl Sync for LlmExecutionResponseCodec