For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
      • Python Library Reference
        • nemo_relay
        • adaptive
        • codecs
        • guardrails
        • integrations
        • intercepts
        • llm
        • observability
        • plugin
        • scope
        • scope_local
        • subscribers
        • tools
        • typed
        • utils
      • Node.js Library Reference
      • Rust Library Reference
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • Modules
ReferenceAPIs

Python Library Reference

||View as Markdown|
Previous

APIs

Next

nemo_relay

Generated from the local python/nemo_relay package source.

Modules

  • nemo_relay: Python bindings for the NeMo Relay runtime.
  • adaptive: Adaptive plugin configuration helpers.
  • codecs: Protocol definitions for request and response codecs used by nemo_relay.llm.
  • guardrails: Global guardrail registration for tools and LLMs.
  • integrations: Optional integrations for NeMo Relay.
    • deepagents: NeMo Relay integrations for Deep Agents.
      • callbacks: Deep Agents callback handler for NeMo Relay observability.
      • middleware: Deep Agents middleware for NeMo Relay observability.
    • langchain: NeMo Relay integrations for LangChain.
      • callbacks: LangChain callback handler that maps run hierarchy to NeMo Relay scopes.
      • middleware: LangChain AgentMiddleware implementation for NeMo Relay.
    • langgraph: NeMo Relay integrations for LangGraph.
      • callbacks: LangGraph callback handler that reuses the LangChain NeMo Relay integration.
  • intercepts: Global middleware intercept registration for tools and LLMs.
  • llm: LLM lifecycle helpers for non-streaming and streaming calls.
  • observability: Observability plugin configuration helpers.
  • plugin: Generic plugin configuration and registration helpers.
  • scope: Scope stack operations.
  • scope_local: Scope-local middleware and subscriber registration.
  • subscribers: Global event subscriber registration.
  • tools: Tool lifecycle helpers.
  • typed: Typed wrappers around the JSON-based NeMo Relay execution APIs.
  • utils