> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt. # Reference ## Docs - [Compatibility](https://docs.nvidia.com/dynamo/v1.5.1/reference/compatibility.md): Hardware, platform, feature, and mixed-version support for Dynamo - [Releases](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases.md): Release history and per-release notes for every Dynamo release, mirrored from GitHub - [Dynamo v1.5.0](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/v1-5-0.md): Release notes for Dynamo v1.5.0 (GA Sep 18, 2026), including patch release v1.5.1 - [Dynamo v1.4.0](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/v1-4-0.md): Release notes for Dynamo v1.4.0 (GA Aug 14, 2026), including patch releases v1.4.1 and v1.4.2 - [Dynamo v1.3.0](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/v1-3-0.md): Release notes for Dynamo v1.3.0 (GA Jul 20, 2026), including patch release v1.3.1 - [Dynamo v1.2.0](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/v1-2-0.md): Release notes for Dynamo v1.2.0 (GA Jun 2, 2026), including patch release v1.2.1 - [Dynamo v1.1.0](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/v1-1-0.md): Release notes for Dynamo v1.1.0 (GA May 1, 2026), including patch release v1.1.1 - [Dynamo v1.0.0](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/v1-0-0.md): Release notes for Dynamo v1.0.0 (GA Mar 12, 2026), including patch releases v1.0.1, v1.0.2 - [Known Issues](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/known-issues.md): Known issues per Dynamo release, mirrored from the GitHub release notes - [Deprecations](https://docs.nvidia.com/dynamo/v1.5.1/reference/releases/deprecations.md): Breaking changes, deprecations, and removals across Dynamo releases - [Release Artifacts](https://docs.nvidia.com/dynamo/v1.5.1/reference/release-artifacts.md): Container images, Python wheels, Helm charts, and Rust crates for the current release, plus early access builds and release history. - [Nightly Releases](https://docs.nvidia.com/dynamo/v1.5.1/reference/nightly-releases.md): Nightly container images, Python wheels, install patterns, and current backend versions. - [Model Early Access Builds](https://docs.nvidia.com/dynamo/v1.5.1/reference/model-early-access-builds.md): Per-model early access container builds shipped ahead of stable releases - [Examples](https://docs.nvidia.com/dynamo/v1.5.1/reference/examples.md): Reference deployments for SGLang, TensorRT-LLM, vLLM, and custom Dynamo backends. - [Glossary](https://docs.nvidia.com/dynamo/v1.5.1/reference/glossary.md): Definitions of core Dynamo terms covering disaggregated serving, KV cache, components, and the distributed runtime. - [API Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/api.md): Language-by-language public surface for Dynamo, discovered from the source tree - [Python API](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python.md): Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree. - [dynamo._core](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/_core.md): Rust-backed distributed runtime, KV router, and endpoint bindings. - [dynamo.runtime](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/runtime.md): Decorators and re-exports for defining Dynamo workers and endpoints. - [dynamo.llm](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/llm.md): High-level LLM primitives for building request pipelines. - [dynamo.frontend](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/frontend.md): OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing. - [dynamo.common](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/common.md): Shared configuration groups, storage adapters, and utility helpers. - [dynamo.health_check](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/health_check.md): Health-check payload types and environment-driven configuration. - [dynamo.logits_processing](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/logits_processing.md): Custom logits processors for LLM token generation. - [dynamo.planner](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/planner.md): Scaling connectors, decision types, and Planner configuration. - [dynamo.router](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/router.md): Request-router configuration and command-line argument groups. - [dynamo.mocker](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/mocker.md): Mock engine used to run Dynamo workflows without a real GPU backend. - [dynamo.nixl_connect](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/python/nixl_connect.md): NIXL RDMA connector primitives for KV cache and tensor transport. - [Rust API](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/rust.md): Published Dynamo crates with release-pinned docs.rs links. - [DynamoGraphDeployment (DGD) Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/kubernetes/dynamo-graph-deployment.md): Field reference for the DynamoGraphDeployment custom resource — the canonical, live description of a Dynamo inference graph. - [DynamoGraphDeploymentRequest (DGDR) Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/kubernetes/dynamo-graph-deployment-request.md): Field reference and lifecycle for the DynamoGraphDeploymentRequest custom resource — Dynamo's deploy-by-intent generator. - [DynamoComponentDeployment (DCD) Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/kubernetes/dynamo-component-deployment.md): Field reference for the DynamoComponentDeployment custom resource — the single Dynamo component that a DynamoGraphDeployment reconciles into pods. - [API Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/api/kubernetes/full-api-reference.md): Full Kubernetes CRD + operator-config API reference, generated from the operator Go types. - [Runtime Configuration (DynamoRuntimeConfig)](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/runtime-configuration.md): Field reference for the cross-cutting Dynamo runtime CLI flags and environment variables shared by every backend and the frontend. - [TLS](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/tls-configuration.md): Encrypt the TCP request/response streams and NATS connections - [Frontend Configuration Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/frontend-configuration.md): Field reference for the Dynamo Frontend CLI arguments, environment variables, and HTTP endpoints. - [Planner Configuration (PlannerConfig)](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/planner-configuration.md): Field reference for the PlannerConfig JSON/YAML object consumed by the Dynamo Planner service. - [Profiler Configuration Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/profiler-configuration.md): Field reference for the Dynamo profiler CLI arguments — the SLA profiler entry point and the low-level per-endpoint profiler. - [KVBM Configuration Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/kvbm-configuration.md): Field reference for the KV Block Manager environment variables and the layered KVBM_* / TOML configuration system. - [Mocker CLI Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/mocker-cli-reference.md): Command-line flags for live Mocker workers - [DynoSim Replay CLI Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/dyno-sim-replay-cli-reference.md): Command options, YAML sections, constraints, and output for aisimulate predict - [DynoSim Sweep Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/dyno-sim-sweep-reference.md): Configuration domains, optimizer controls, and output for aisimulate recommend - [Global Router Configuration](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/global-router-configuration.md): Field reference for the CLI flags and JSON config file consumed by the Global Router service. - [Gateway API Routing Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/gateway-api-routing.md): Dynamo Endpoint Picker Plugin fields, generated resources, runtime settings, and request contracts. - [ThunderAgent Scheduler Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/components/thunder-agent-scheduler.md): Control-loop flags, constraints, capacity behavior, and scheduler log records - [vLLM Configuration (DynamoVllmConfig)](https://docs.nvidia.com/dynamo/v1.5.1/reference/backends/v-llm-configuration.md): Field reference for the Dynamo-specific CLI flags and environment variables of the vLLM backend wrapper. - [vLLM-Omni Configuration](https://docs.nvidia.com/dynamo/v1.5.1/reference/backends/v-llm-omni-configuration.md): CLI flag reference for the vLLM-Omni multimodal backend (python -m dynamo.vllm.omni). - [SGLang Configuration (DynamoSGLangConfig)](https://docs.nvidia.com/dynamo/v1.5.1/reference/backends/sg-lang-configuration.md): Field reference for the Dynamo-specific CLI flags and environment variables of the SGLang backend wrapper. - [TensorRT-LLM Configuration (DynamoTrtllmConfig)](https://docs.nvidia.com/dynamo/v1.5.1/reference/backends/tensor-rt-llm-configuration.md): Field reference for the Dynamo-specific CLI flags and environment variables of the TensorRT-LLM backend wrapper. - [Local Observability Stack Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/local-stack.md): Services, ports, signal flow, and configuration files for the Docker Compose stack - [Health Check Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/health-checks.md): Health endpoints, status codes, paths, and active-check configuration - [Logging Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/logging.md): Log formats, levels, correlation fields, and backend controls - [Forward Pass Metrics Trace Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/forward-pass-metrics-traces.md): Configuration, topology support, file rotation, and the dynamo.fpm.trace.v1 schema - [Request Trace Reference](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/request-traces.md): Record selection, sinks, rotation, OTLP export, and the dynamo.request.trace.v1 schema - [Environment Variables](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/environment-variables.md): Every environment variable that controls Dynamo metrics, tracing, logging, health checks, and request capture. - [Metrics Catalog](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/metrics-catalog.md): Every dynamo_* metric emitted by the frontend, backend workers, and router — name, type, and meaning. - [Engine Metrics Comparison](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/metrics-comparison.md) - [Metric Labels](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/metric-labels.md): Every label dimension attached to Dynamo metric series — where each one comes from and the values it can take. - [Operator Metrics](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/operator-metrics.md): Kubernetes-only dynamo_operator_* metrics and the annotations and Helm values that enable metrics collection. - [Local Resource Monitor (Local)](https://docs.nvidia.com/dynamo/v1.5.1/reference/observability/local-resource-monitor-local.md): Host-side per-process VRAM / PCIe / CPU exporter for engine-startup profiling — metrics and CLI flags. - [NIXL Connect API](https://docs.nvidia.com/dynamo/v1.5.1/reference/nixl-connect/overview.md): Python library for dynamic, RDMA-accelerated data transfers between workers in a Dynamo graph. - [Overview](https://docs.nvidia.com/dynamo/v1.5.1/reference/enterprise/overview.md): Commercial support for a curated set of NVIDIA Dynamo release artifacts. - [Supported Artifacts](https://docs.nvidia.com/dynamo/v1.5.1/reference/enterprise/supported-artifacts.md): The exact container images and Helm chart eligible for NVIDIA Enterprise Support. - [Install](https://docs.nvidia.com/dynamo/v1.5.1/reference/enterprise/install.md): Pull the enterprise images and Helm chart, and reference them from your deployments. - [Support Coverage](https://docs.nvidia.com/dynamo/v1.5.1/reference/enterprise/support-coverage.md): What NVIDIA Enterprise Support commits to for the covered Dynamo artifacts. - [Scope Boundaries](https://docs.nvidia.com/dynamo/v1.5.1/reference/enterprise/scope-boundaries.md): What sits outside the Dynamo Enterprise support scope, and how it relates to what is inside.