> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# Router

## Docs

- [Router](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/overview.md): KV cache-aware router that picks workers by combined prefill and decode cost to maximize throughput and minimize latency.
- [Router Guide](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/router-guide.md): Deployment modes, quick start, and page map for Dynamo routing docs
- [Routing Concepts](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/routing-concepts.md): Cost model, worker selection, and routing primitives for the Dynamo router
- [Router Filtering](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/router-filtering.md): Candidate eligibility, DP-rank filtering, and queue backpressure boundaries
- [Configuration and Tuning](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/configuration-and-tuning.md): Router behavior, event transport, load tracking, and tuning guidance
- [Deficit Round Robin Queue Scheduling](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/deficit-round-robin.md): Weighted arbitration across router policy classes
- [Disaggregated Serving](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/disaggregated-serving.md): Prefill and decode routing with the Dynamo router
- [Offloading Support Matrix](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/offloading-support-matrix.md): Per-framework support and setup for KV routing with tiered KV cache offloading
- [Topology-Aware KV Transfer](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/topology-aware-kv-transfer.md): Runtime metadata and decode routing semantics for topology-aware prefill/decode handoff
- [Multi-DC KV Routing and the DC Relay](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/multi-dc-kv-routing.md): Aggregate exact KV ownership in each DC and publish compact state to a global consumer
- [Router Operations](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/router-operations.md): Replica topology, state management, recovery, and remote indexers
- [Router Testing](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/router-testing.md): Test layers for router changes
- [Router Examples](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/router-examples.md): Worked examples for the KvRouter Python API, Kubernetes deployments, and custom routing patterns.
- [Global Router Configuration](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/global-router-configuration.md): Field reference for the CLI flags and JSON config file consumed by the Global Router service.
- [Standalone KV Indexer](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/standalone-indexer.md): Run the KV cache indexer as an independent HTTP service for querying block state
- [Standalone Slot Tracker](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/standalone-slot-tracker.md): Run active-request load accounting as an independent HTTP service
- [Standalone Selection Service](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/standalone-selection.md): Select workers and account for reservations without forwarding inference requests
- [KV Event Replay — Dynamo vs vLLM](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/kv-event-replay-comparison.md): How the two systems handle gap detection, replay, and recovery for KV cache events
- [Router Design](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/router/router-design.md)