For AI agents: a documentation index is available at the root level at /llms.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
LogoLogoDynamo
HomeKubernetes GuideCLI GuideUse CasesRecipesDeveloper GuideReferenceBlogCommunity
HomeKubernetes GuideCLI GuideUse CasesRecipesDeveloper GuideReferenceBlogCommunity
    • Compatibility
    • Releases
    • Release Artifacts
    • Nightly Releases
    • Model Early Access Builds
    • Examples
    • API Reference
    • Python API
      • dynamo._core
      • dynamo.runtime
      • dynamo.llm
      • dynamo.frontend
      • dynamo.common
      • dynamo.health_check
      • dynamo.logits_processing
      • dynamo.planner
      • dynamo.router
      • dynamo.mocker
      • dynamo.nixl_connect
    • Rust API
    • Glossary
  • Compatibility
  • Releases
  • Dynamo v1.3.0
  • Dynamo v1.2.0
  • Dynamo v1.1.0
  • Dynamo v1.0.0
  • Known Issues
  • Deprecations
  • Release Artifacts
  • Nightly Releases
  • Model Early Access Builds
  • Examples
  • API Reference
  • Python API
  • dynamo._core
  • dynamo.runtime
  • dynamo.llm
  • dynamo.frontend
  • dynamo.common
  • dynamo.health_check
  • dynamo.logits_processing
  • dynamo.planner
  • dynamo.router
  • dynamo.mocker
  • dynamo.nixl_connect
  • Rust API
  • DynamoGraphDeployment
  • DynamoGraphDeploymentRequest
  • DynamoComponentDeployment
  • Full API Reference
  • Runtime Configuration
  • TLS Configuration
  • Frontend Configuration
  • Planner Configuration
  • Profiler Configuration
  • KVBM Configuration
  • Mocker CLI Reference
  • DynoSim Replay CLI Reference
  • DynoSim Sweep Reference
  • Global Router Configuration
  • Gateway API Routing
  • ThunderAgent Scheduler
  • vLLM Configuration
  • vLLM-Omni Configuration
  • SGLang Configuration
  • TensorRT-LLM Configuration
  • Local Stack
  • Health Checks
  • Logging
  • Forward Pass Metrics Traces
  • Request Traces
  • Environment Variables
  • Metrics Catalog
  • Metrics Comparison
  • Metric Labels
  • Operator Metrics
  • Local Resource Monitor (Local)
  • Overview
  • Glossary

Python API

Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree.
||View as Markdown|

Dynamo publishes 11 Python modules with 365 public class and function symbols under dynamo.*.

dynamo._core
89 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.
dynamo.runtime
17 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.
dynamo.llm
47 symbols. High-level LLM primitives for building request pipelines.
dynamo.frontend
43 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.
dynamo.common
80 symbols. Shared configuration groups, storage adapters, and utility helpers.
dynamo.health_check
2 symbols. Health-check payload types and environment-driven configuration.
dynamo.logits_processing
4 symbols. Custom logits processors for LLM token generation.
dynamo.planner
36 symbols. Scaling connectors, decision types, and Planner configuration.
dynamo.router
7 symbols. Request-router configuration and command-line argument groups.
dynamo.mocker
23 symbols. Mock engine used to run Dynamo workflows without a real GPU backend.
dynamo.nixl_connect
17 symbols. NIXL RDMA connector primitives for KV cache and tensor transport.
Previous

API Reference

Next

dynamo._core

NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.