Struct LlmExecution Request Codec

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmExecutionRequestCodec { /* private fields */ }

Invocation-lifetime request codec facade for an LLM execution intercept.

Implementations

impl LlmExecutionRequestCodec

impl LlmExecutionRequestCodec

decode

pub fn decode(&self, request: &LlmRequest) -> Result<AnnotatedLlmRequest>

Decode an opaque request into Relay’s normalized request model.

encode

pub fn encode(
    &self,
    annotated: &AnnotatedLlmRequest,
    original: &LlmRequest,
) -> Result<LlmRequest>

Encode normalized changes onto the original opaque request.

Trait Implementations

impl Drop for LlmExecutionRequestCodec

impl Drop for LlmExecutionRequestCodec

drop

fn drop(&mut self)

impl Send for LlmExecutionRequestCodec

impl Send for LlmExecutionRequestCodec

impl Sync for LlmExecutionRequestCodec

impl Sync for LlmExecutionRequestCodec