dynamo.router | NVIDIA Dynamo Documentation

dynamo.router publishes 3 classes and 4 functions. Source: components/src/dynamo/router/__init__.py

CLI argument group for standalone router options.

1 from dynamo.router.args import DynamoRouterArgGroup

Public methods

1 add_arguments(parser) -> None

Add router-owned arguments to parser.

Typed configuration for the standalone KV router (router-owned options only).

1 from dynamo.router.args import DynamoRouterConfig

Public methods

1 validate() -> None

Validate config invariants (aligned with Rust KvRouterConfig where applicable).

Router search-space preparation and replay-spec materialization.

1 from dynamo.router.simulation import DynamoRouterSweepConfigProvider

Public methods

1 compile_prediction(config: Mapping[str, JSONValue], context: PredictionAdapterContext) -> AdapterReplaySpec

No summary available.

1 compile_recommendation(config: Mapping[str, JSONValue], context: RecommendationAdapterContext) -> AdapterSearchPlan

No summary available.

1 materialize_candidate(plan: AdapterSearchPlan, selection: Mapping[str, JSONValue], context: CandidateContext) -> AdapterReplaySpec

No summary available.

1 generate_search_space(search_spec: Mapping[str, JSONValue], context: SweepContext) -> AdapterSearchPlan

No summary available.

1 materialize_replay(plan: AdapterSearchPlan, selection: Mapping[str, JSONValue], context: CandidateContext) -> AdapterReplaySpec

No summary available.

No summary available.

1 from dynamo.router.args import build_aic_perf_config

1 build_aic_perf_config(router_config: DynamoRouterConfig) -> AicPerfConfig | None

Build KvRouterConfig from DynamoRouterConfig.

1 from dynamo.router.args import build_kv_router_config

1 build_kv_router_config(router_config: DynamoRouterConfig) -> KvRouterConfig

Create the entry-point registered Router sweep configuration provider.

1 from dynamo.router.simulation import create_provider

1 create_provider() -> DynamoRouterSweepConfigProvider

Parse command-line arguments for the standalone router.

1 from dynamo.router.args import parse_args

1 parse_args(argv: Optional[list[str]] = None) -> DynamoRouterConfig

Returns