For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
      • Python Library Reference
      • Node.js Library Reference
      • Rust Library Reference
        • nemo-relay
          • api
            • event
            • llm
              • CreateLlmHandleParams
              • EndLlmHandleParams
              • LlmAttributes
              • LlmCallEndParams
              • LlmCallExecuteParams
              • LlmCallParams
              • LlmHandle
              • LlmRequest
              • LlmStreamCallExecuteParams
              • llm_call
              • llm_call_end
              • llm_call_execute
              • llm_conditional_execution
              • llm_request_intercepts
              • llm_stream_call_execute
            • registry
            • runtime
            • scope
            • subscriber
            • tool
          • codec
          • config_editor
          • error
          • json
          • observability
          • plugin
          • plugins
          • stream
          • editor_config
        • nemo-relay-adaptive
        • nemo-relay-ffi
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • Fields
  • uuid: Uuid
  • started_at: DateTime<Utc>
  • name: String
  • data: Option<Json>
  • metadata: Option<Json>
  • attributes: LlmAttributes
  • parent_uuid: Option<Uuid>
  • model_name: Option<String>
  • Implementations
  • impl LlmHandle
  • builder
  • Trait Implementations
  • impl Clone for LlmHandle
  • clone
  • clone_from
  • impl Debug for LlmHandle
  • fmt
  • impl<'de> Deserialize<'de> for LlmHandle
  • deserialize
  • impl Serialize for LlmHandle
  • serialize
ReferenceAPIsRust Library Referencenemo-relayapillm

Struct LlmHandle

||View as Markdown|
Previous

Struct LlmCall Params

Next

Struct LlmRequest

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub struct LlmHandle {
    pub uuid: Uuid,
    pub started_at: DateTime<Utc>,
    pub name: String,
    pub data: Option<Json>,
    pub metadata: Option<Json>,
    pub attributes: LlmAttributes,
    pub parent_uuid: Option<Uuid>,
    pub model_name: Option<String>,
}

Runtime-owned handle identifying an active or completed LLM call.

Fields

uuid: Uuid

Unique LLM-call identifier.

started_at: DateTime<Utc>

Timestamp captured when the LLM handle was created.

name: String

Provider or logical call name recorded on lifecycle events.

data: Option<Json>

Optional application payload stored on the handle.

metadata: Option<Json>

Optional metadata attached to the LLM span.

attributes: LlmAttributes

LLM behavior flags.

parent_uuid: Option<Uuid>

UUID of the parent scope, if any.

model_name: Option<String>

Optional normalized model name for observability.

Implementations

impl LlmHandle

impl LlmHandle

builder

pub fn builder() -> LlmHandleBuilder<((), (), (), (), (), (), (), ())>

Create a builder for building LlmHandle. On the builder, call .uuid(...)(optional), .started_at(...)(optional), .name(...), .data(...)(optional), .metadata(...)(optional), .attributes(...)(optional), .parent_uuid(...)(optional), .model_name(...)(optional) to set the values of the fields. Finally, call .build() to create the instance of LlmHandle.

Trait Implementations

impl Clone for LlmHandle

impl Clone for LlmHandle

clone

fn clone(&self) -> LlmHandle

clone_from

fn clone_from(&mut self, source: &Self)

impl Debug for LlmHandle

impl Debug for LlmHandle

fmt

fn fmt(&self, f: &mut Formatter<'_>) -> Result

impl<'de> Deserialize<'de> for LlmHandle

impl<'de> Deserialize<'de> for LlmHandle

deserialize

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

impl Serialize for LlmHandle

impl Serialize for LlmHandle

serialize

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,