Python API
Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree.
This page is for version v1.4.0.
For other versions, use one of these documentation indexes:
- Latest (v1.5.1) (default): https://docs.nvidia.com/dynamo/latest/llms.txt
- dev: https://docs.nvidia.com/dynamo/dev/llms.txt
- v1.5.1: https://docs.nvidia.com/dynamo/v1.5.1/llms.txt
- v1.5.0: https://docs.nvidia.com/dynamo/v1.5.0/llms.txt
- v1.4.2: https://docs.nvidia.com/dynamo/v1.4.2/llms.txt
- v1.4.1: https://docs.nvidia.com/dynamo/v1.4.1/llms.txt
- v1.4.0: https://docs.nvidia.com/dynamo/v1.4.0/llms.txt
- v1.3.0: https://docs.nvidia.com/dynamo/v1.3.0/llms.txt
- v1.2.1: https://docs.nvidia.com/dynamo/v1.2.1/llms.txt
- v1.2.0: https://docs.nvidia.com/dynamo/v1.2.0/llms.txt
- v1.1.1: https://docs.nvidia.com/dynamo/v1.1.1/llms.txt
- v1.1.0: https://docs.nvidia.com/dynamo/v1.1.0/llms.txt
- v1.0.2: https://docs.nvidia.com/dynamo/v1.0.2/llms.txt
- v1.0.1: https://docs.nvidia.com/dynamo/v1.0.1/llms.txt
- v1.0.0: https://docs.nvidia.com/dynamo/v1.0.0/llms.txt
- v0.9.1: https://docs.nvidia.com/dynamo/v-0-9-1/llms.txt
- v0.9.0: https://docs.nvidia.com/dynamo/v-0-9-0/llms.txt
- v0.8.1: https://docs.nvidia.com/dynamo/v-0-8-1/llms.txt
- v0.8.0: https://docs.nvidia.com/dynamo/v-0-8-0/llms.txt
- v0.7.1: https://docs.nvidia.com/dynamo/v-0-7-1/llms.txt
- v0.7.0: https://docs.nvidia.com/dynamo/v-0-7-0/llms.txt
Dynamo publishes 11 Python modules with 369 public class and function symbols under dynamo.*.
dynamo._core
97 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.
dynamo.runtime
17 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.
dynamo.llm
46 symbols. High-level LLM primitives for building request pipelines.
dynamo.frontend
43 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.
dynamo.common
77 symbols. Shared configuration groups, storage adapters, and utility helpers.
dynamo.health_check
2 symbols. Health-check payload types and environment-driven configuration.
dynamo.logits_processing
4 symbols. Custom logits processors for LLM token generation.
dynamo.planner
31 symbols. Scaling connectors, decision types, and Planner configuration.
dynamo.router
5 symbols. Request-router configuration and command-line argument groups.
dynamo.mocker
30 symbols. Mock engine used to run Dynamo workflows without a real GPU backend.
dynamo.nixl_connect
17 symbols. NIXL RDMA connector primitives for KV cache and tensor transport.