Struct Nemo Relay Native LlmExecution Context

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

#[repr(C)]pub struct NemoRelayNativeLlmExecutionContext {
    pub request_codec: NemoRelayNativeLlmRequestContext,
    pub response_codec: *const NemoRelayNativeLlmResponseContext,
}

Codec context passed to native LLM execution intercept callbacks.

The context and codec IDs are borrowed for the callback. A synchronous streaming callback may retain the request codec pointer only in the state of its returned NemoRelayNativeLlmStreamV1; it remains valid until Relay invokes that stream’s drop callback. Other raw callbacks must not retain codec pointers. Asynchronous streaming callbacks must instead retain the output stream and use the v7 stream codec functions.

Fields

`request_codec: NemoRelayNativeLlmRequestContext`

Request codec context, always present.

`response_codec: *const NemoRelayNativeLlmResponseContext`

Completed-response codec context, or null for streaming execution.

Trait Implementations

`impl Clone for NemoRelayNativeLlmExecutionContext`

impl Clone for NemoRelayNativeLlmExecutionContext

`clone`

fn clone(&self) -> NemoRelayNativeLlmExecutionContext

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for NemoRelayNativeLlmExecutionContext`

impl Debug for NemoRelayNativeLlmExecutionContext

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl Copy for NemoRelayNativeLlmExecutionContext`

impl Copy for NemoRelayNativeLlmExecutionContext