For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • CLI
  • Python
  • Node.js
  • Rust
  • Integrations
  • OpenClaw
  • Python Framework Integrations
Getting Started

Installation

||View as Markdown|
Previous

Prerequisites

Next

Configuration

Use this page when you are consuming a published NeMo Relay release from a package manager.

If you are working from a source checkout, validating unpublished changes, or contributing to the repository, use Development Setup instead.

CLI

Install the NeMo Relay CLI when you want the nemo-relay executable for coding-agent hook and LLM gateway observability.

$cargo install nemo-relay-cli@0.4.0

Python

Install the Python package when your application uses NeMo Relay through the Python wrapper.

$uv add nemo-relay@0.4.0

Use uv add from an application project that has a pyproject.toml; it records nemo-relay as a project dependency. If you are only installing into an active virtual environment and do not have project metadata, use uv pip install nemo-relay instead. You can also use pip install nemo-relay if you are not managing the environment with uv.

Node.js

Install the Node.js package when your application uses NeMo Relay through the JavaScript API.

$npm install nemo-relay-node

Rust

Add the Rust crates when your application uses NeMo Relay directly from Rust.

$cargo add nemo-relay@0.4.0
$cargo add nemo-relay-adaptive@0.4.0
  • nemo-relay provides the core runtime APIs for scopes, middleware, subscribers, plugins, tool calls, and LLM calls.
  • nemo-relay-adaptive provides adaptive runtime primitives and Redis-backed learning components when you want adaptive tuning behavior in Rust.

Integrations

Install integration packages when your application already uses one of the supported framework or agent harness surfaces.

OpenClaw

Install the OpenClaw plugin through OpenClaw so OpenClaw can register and manage the package:

$openclaw plugins install npm:nemo-relay-openclaw@0.4.0
$openclaw gateway restart

Use the package name nemo-relay-openclaw for installation. Use the plugin ID nemo-relay in OpenClaw configuration, inspection, and gateway status commands. See the OpenClaw Plugin Guide for configuration and verification steps.

Python Framework Integrations

Install the Python package with the supported framework extras when your application uses LangChain, LangGraph, or Deep Agents.

$uv add "nemo-relay[langchain,langgraph,deepagents]@0.4.0"

The extras install the NeMo Relay Python package plus the dependencies needed by the maintained public integrations. See Supported Integrations for guide links and support levels.