Python API

Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree.

Dynamo publishes 11 Python modules with 384 public class and function symbols under dynamo.*.

93 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.

19 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.

52 symbols. High-level LLM primitives for building request pipelines.

dynamo.frontend

50 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.

82 symbols. Shared configuration groups, storage adapters, and utility helpers.

dynamo.health_check

2 symbols. Health-check payload types and environment-driven configuration.

dynamo.logits_processing

4 symbols. Custom logits processors for LLM token generation.

37 symbols. Scaling connectors, decision types, and Planner configuration.

7 symbols. Request-router configuration and command-line argument groups.

21 symbols. Mock engine used to run Dynamo workflows without a real GPU backend.

dynamo.nixl_connect

17 symbols. NIXL RDMA connector primitives for KV cache and tensor transport.