ReferenceAPIsRust Library Referencenemo-relaycodectraits

Trait LlmResponse Encoder

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub trait LlmResponseEncoder: Send + Sync {
    // Required method
    fn encode_response(&self, response: &AnnotatedLlmResponse) -> Result<Json>;
}

Additive encoder for materializing a normalized response in a provider wire format.

Existing response codecs remain decode-only. Components that perform cross-protocol dispatch can supply this companion trait without changing the managed observability pipeline.

Required Methods

encode_response

fn encode_response(&self, response: &AnnotatedLlmResponse) -> Result<Json>

Encode a normalized response into the target provider’s buffered JSON representation.

Implementors