Python API
Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree.
This page is for version v1.5.0.
For other versions, use one of these documentation indexes:
- Latest (v1.6.1) (default): https://docs.nvidia.com/dynamo/latest/llms.txt
- dev: https://docs.nvidia.com/dynamo/dev/llms.txt
- v1.6.1: https://docs.nvidia.com/dynamo/v1.6.1/llms.txt
- v1.6.0: https://docs.nvidia.com/dynamo/v1.6.0/llms.txt
- v1.5.1: https://docs.nvidia.com/dynamo/v1.5.1/llms.txt
- v1.5.0: https://docs.nvidia.com/dynamo/v1.5.0/llms.txt
- v1.4.2: https://docs.nvidia.com/dynamo/v1.4.2/llms.txt
- v1.4.1: https://docs.nvidia.com/dynamo/v1.4.1/llms.txt
- v1.4.0: https://docs.nvidia.com/dynamo/v1.4.0/llms.txt
- v1.3.0: https://docs.nvidia.com/dynamo/v1.3.0/llms.txt
- v1.2.1: https://docs.nvidia.com/dynamo/v1.2.1/llms.txt
- v1.2.0: https://docs.nvidia.com/dynamo/v1.2.0/llms.txt
- v1.1.1: https://docs.nvidia.com/dynamo/v1.1.1/llms.txt
- v1.1.0: https://docs.nvidia.com/dynamo/v1.1.0/llms.txt
- v1.0.2: https://docs.nvidia.com/dynamo/v1.0.2/llms.txt
- v1.0.1: https://docs.nvidia.com/dynamo/v1.0.1/llms.txt
- v1.0.0: https://docs.nvidia.com/dynamo/v1.0.0/llms.txt
- v0.9.1: https://docs.nvidia.com/dynamo/v-0-9-1/llms.txt
- v0.9.0: https://docs.nvidia.com/dynamo/v-0-9-0/llms.txt
- v0.8.1: https://docs.nvidia.com/dynamo/v-0-8-1/llms.txt
- v0.8.0: https://docs.nvidia.com/dynamo/v-0-8-0/llms.txt
- v0.7.1: https://docs.nvidia.com/dynamo/v-0-7-1/llms.txt
- v0.7.0: https://docs.nvidia.com/dynamo/v-0-7-0/llms.txt
Dynamo publishes 11 Python modules with 376 public class and function symbols under dynamo.*.
dynamo._core
93 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.
dynamo.runtime
17 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.
dynamo.llm
50 symbols. High-level LLM primitives for building request pipelines.
dynamo.frontend
46 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.
dynamo.common
82 symbols. Shared configuration groups, storage adapters, and utility helpers.
dynamo.health_check
2 symbols. Health-check payload types and environment-driven configuration.
dynamo.logits_processing
4 symbols. Custom logits processors for LLM token generation.
dynamo.planner
37 symbols. Scaling connectors, decision types, and Planner configuration.
dynamo.router
7 symbols. Request-router configuration and command-line argument groups.
dynamo.mocker
21 symbols. Mock engine used to run Dynamo workflows without a real GPU backend.
dynamo.nixl_connect
17 symbols. NIXL RDMA connector primitives for KV cache and tensor transport.