Struct LlmHandle | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmHandle {
    pub uuid: Uuid,
    pub started_at: DateTime<Utc>,
    pub name: String,
    pub data: Option<Json>,
    pub metadata: Option<Json>,
    pub attributes: LlmAttributes,
    pub parent_uuid: Option<Uuid>,
    pub model_name: Option<String>,
}

Runtime-owned handle identifying an active or completed LLM call.

Fields

`uuid: Uuid`

Unique LLM-call identifier.

`started_at: DateTime<Utc>`

Timestamp captured when the LLM handle was created.

`name: String`

Provider or logical call name recorded on lifecycle events.

Gateway-managed provider calls use provider route names such as anthropic.messages; event normalization may reuse those route names as codec hints when raw request shapes overlap across providers.

`data: Option<Json>`

Optional application payload stored on the handle.

`metadata: Option<Json>`

Optional metadata attached to the LLM span.

`attributes: LlmAttributes`

LLM behavior flags.

`parent_uuid: Option<Uuid>`

UUID of the parent scope, if any.

`model_name: Option<String>`

Optional normalized model name for observability.

Implementations

`impl LlmHandle`

impl LlmHandle

`builder`

pub fn builder() -> LlmHandleBuilder<((), (), (), (), (), (), (), ())>

Create a builder for building LlmHandle. On the builder, call .uuid(...)(optional), .started_at(...)(optional), .name(...), .data(...)(optional), .metadata(...)(optional), .attributes(...)(optional), .parent_uuid(...)(optional), .model_name(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of LlmHandle.

Trait Implementations

`impl Clone for LlmHandle`

impl Clone for LlmHandle

`clone`

fn clone(&self) -> LlmHandle

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for LlmHandle`

impl Debug for LlmHandle

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl<'de> Deserialize<'de> for LlmHandle`

impl<'de> Deserialize<'de> for LlmHandle

`deserialize`

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

`impl Serialize for LlmHandle`

impl Serialize for LlmHandle

`serialize`

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,