Python API
Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree.
This page is for version dev.
For other versions, use one of these documentation indexes:
- Latest (v1.6.1) (default): https://docs.nvidia.com/dynamo/latest/llms.txt
- dev: https://docs.nvidia.com/dynamo/dev/llms.txt
- v1.6.1: https://docs.nvidia.com/dynamo/v1.6.1/llms.txt
- v1.6.0: https://docs.nvidia.com/dynamo/v1.6.0/llms.txt
- v1.5.1: https://docs.nvidia.com/dynamo/v1.5.1/llms.txt
- v1.5.0: https://docs.nvidia.com/dynamo/v1.5.0/llms.txt
- v1.4.2: https://docs.nvidia.com/dynamo/v1.4.2/llms.txt
- v1.4.1: https://docs.nvidia.com/dynamo/v1.4.1/llms.txt
- v1.4.0: https://docs.nvidia.com/dynamo/v1.4.0/llms.txt
- v1.3.0: https://docs.nvidia.com/dynamo/v1.3.0/llms.txt
- v1.2.1: https://docs.nvidia.com/dynamo/v1.2.1/llms.txt
- v1.2.0: https://docs.nvidia.com/dynamo/v1.2.0/llms.txt
- v1.1.1: https://docs.nvidia.com/dynamo/v1.1.1/llms.txt
- v1.1.0: https://docs.nvidia.com/dynamo/v1.1.0/llms.txt
- v1.0.2: https://docs.nvidia.com/dynamo/v1.0.2/llms.txt
- v1.0.1: https://docs.nvidia.com/dynamo/v1.0.1/llms.txt
- v1.0.0: https://docs.nvidia.com/dynamo/v1.0.0/llms.txt
- v0.9.1: https://docs.nvidia.com/dynamo/v-0-9-1/llms.txt
- v0.9.0: https://docs.nvidia.com/dynamo/v-0-9-0/llms.txt
- v0.8.1: https://docs.nvidia.com/dynamo/v-0-8-1/llms.txt
- v0.8.0: https://docs.nvidia.com/dynamo/v-0-8-0/llms.txt
- v0.7.1: https://docs.nvidia.com/dynamo/v-0-7-1/llms.txt
- v0.7.0: https://docs.nvidia.com/dynamo/v-0-7-0/llms.txt
Dynamo publishes 11 Python modules with 441 public class and function symbols under dynamo.*.
dynamo._core
100 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.
dynamo.runtime
19 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.
dynamo.llm
55 symbols. High-level LLM primitives for building request pipelines.
dynamo.frontend
70 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.
dynamo.common
92 symbols. Shared configuration groups, storage adapters, and utility helpers.
dynamo.health_check
2 symbols. Health-check payload types and environment-driven configuration.
dynamo.logits_processing
4 symbols. Custom logits processors for LLM token generation.
dynamo.planner
54 symbols. Scaling connectors, decision types, and Planner configuration.
dynamo.router
7 symbols. Request-router configuration and command-line argument groups.
dynamo.mocker
21 symbols. Mock engine used to run Dynamo workflows without a real GPU backend.
dynamo.nixl_connect
17 symbols. NIXL RDMA connector primitives for KV cache and tensor transport.