Struct LlmHandle

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmHandle {
    pub uuid: Uuid,
    pub started_at: DateTime<Utc>,
    pub name: String,
    pub data: Option<Value>,
    pub metadata: Option<Value>,
    pub attributes: LlmAttributes,
    pub parent_uuid: Option<Uuid>,
    pub model_name: Option<String>,
    pub optimization_recorder: LlmOptimizationRecorder,
    /* private fields */
}

Runtime-owned handle identifying an active or completed LLM call.

Fields

`uuid: Uuid`

Unique LLM-call identifier.

`started_at: DateTime<Utc>`

Timestamp captured when the LLM handle was created.

`name: String`

Provider or logical call name recorded on lifecycle events.

Gateway-managed provider calls use provider route names such as anthropic.messages; event normalization may reuse those route names as codec hints when raw request shapes overlap across providers.

`data: Option<Value>`

Optional application payload stored on the handle.

`metadata: Option<Value>`

Optional metadata attached to the LLM span.

`attributes: LlmAttributes`

LLM behavior flags.

`parent_uuid: Option<Uuid>`

UUID of the parent scope, if any.

`model_name: Option<String>`

Optional normalized model name for observability.

`optimization_recorder: LlmOptimizationRecorder`

Bounded, in-memory optimization evidence recorder for this call.

Implementations

`impl LlmHandle`

impl LlmHandle

`builder`

pub fn builder() -> LlmHandleBuilder

Create a builder for building LlmHandle. On the builder, call .uuid(...)(optional), .started_at(...)(optional), .name(...), .data(...)(optional), .metadata(...)(optional), .attributes(...)(optional), .parent_uuid(...)(optional), .model_name(...)(optional), .optimization_recorder(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of LlmHandle.

Trait Implementations

`impl Clone for LlmHandle`

impl Clone for LlmHandle

`clone`

fn clone(&self) -> LlmHandle

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for LlmHandle`

impl Debug for LlmHandle

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

`impl<'de> Deserialize<'de> for LlmHandle`

impl<'de> Deserialize<'de> for LlmHandle

`deserialize`

fn deserialize<__D>(
    __deserializer: __D,
) -> Result<LlmHandle, <__D as Deserializer<'de>>::Error>where
    __D: Deserializer<'de>,

`impl Serialize for LlmHandle`

impl Serialize for LlmHandle

`serialize`

fn serialize<__S>(
    &self,
    __serializer: __S,
) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>where
    __S: Serializer,