For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
      • Python Library Reference
        • nemo_relay
        • adaptive
        • codecs
        • guardrails
        • integrations
        • intercepts
        • llm
        • observability
        • plugin
        • scope
        • scope_local
        • subscribers
        • tools
        • typed
        • utils
      • Node.js Library Reference
      • Rust Library Reference
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • Functions
  • get_scope_stack
  • scope_stack_active
  • propagate_scope_to_thread
  • create_scope_stack
  • set_thread_scope_stack
  • Type Aliases And Constants
  • Re-exports
ReferenceAPIsPython Library Reference

nemo_relay

||View as Markdown|
Previous

Python Library Reference

Next

nemo_relay.adaptive

Generated from python/nemo_relay/__init__.pyi.

Module nemo_relay.

Python bindings for the NeMo Relay runtime.

Functions

get_scope_stack

1def get_scope_stack() -> ScopeStack

Return the current task’s active scope stack.

scope_stack_active

1def scope_stack_active() -> bool

Report whether the current context already owns a scope stack.

propagate_scope_to_thread

1def propagate_scope_to_thread() -> ScopeStack

Capture the active scope stack for use in another thread.

create_scope_stack

1def create_scope_stack() -> ScopeStack

Create a new isolated scope stack.

set_thread_scope_stack

1def set_thread_scope_stack(stack: ScopeStack) -> None

Install a scope stack into the current thread’s native runtime context.

Type Aliases And Constants

  • Event
  • Json
  • JsonObject
  • JsonPrimitive
  • JsonValue
  • LlmConditionalExecutionGuardrail
  • LlmExecutionIntercept
  • LlmRequestIntercept
  • LlmSanitizeRequestGuardrail
  • LlmSanitizeResponseGuardrail
  • LlmStreamExecutionIntercept
  • ToolConditionalExecutionGuardrail
  • ToolExecutionIntercept
  • ToolRequestIntercept
  • ToolSanitizeGuardrail
  • UnsupportedBehavior

Re-exports

  • AnnotatedLLMRequest
  • AnnotatedLLMResponse
  • AtifExporter
  • AtofExporter
  • AtofExporterConfig
  • AtofExporterMode
  • LLMAttributes
  • LLMHandle
  • LLMRequest
  • MarkEvent
  • OpenInferenceConfig
  • OpenInferenceSubscriber
  • OpenTelemetryConfig
  • OpenTelemetrySubscriber
  • ScopeAttributes
  • ScopeEvent
  • ScopeHandle
  • ScopeStack
  • ScopeType
  • ToolAttributes
  • ToolHandle
  • adaptive
  • codecs
  • guardrails
  • intercepts
  • llm
  • observability
  • plugin
  • scope
  • scope_local
  • subscribers
  • tools
  • typed