> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# Concepts

## Docs

- [Architecture Flow](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/system-architecture/architecture-flow.md)
- [Distributed Runtime](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/system-architecture/distributed-runtime.md)
- [Sidecar Backends](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/system-architecture/sidecar-backends-experimental.md): Run Dynamo beside a stock inference engine through its native gRPC API.
- [Disaggregated Serving](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/system-architecture/disaggregated-serving.md)
- [Discovery Plane](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/communication-planes/discovery-plane.md)
- [Request Plane](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/communication-planes/request-plane.md)
- [Event Plane](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/communication-planes/event-plane.md)
- [Observability Architecture](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/observability-architecture.md): Signal transport, request correlation, and active worker health checks
- [DynoSim Architecture](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/simulation/dyno-sim-architecture.md): How the replay harness composes simulated engines, routing, and Planner behavior
- [Request Migration Architecture](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/fault-tolerance/request-migration-architecture.md): Preserve token state and reissue in-flight requests on healthy workers after a worker failure.
- [Request Cancellation Architecture](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/fault-tolerance/request-cancellation-architecture.md): Cancel in-flight work across the Frontend and workers when a client disconnects.
- [Request Rejection Architecture](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/fault-tolerance/request-rejection-architecture.md): Worker-load event processing, busy-state aggregation, overload errors, and hard worker admission limits.
- [Graceful Shutdown Architecture](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/fault-tolerance/graceful-shutdown-architecture.md)
- [Fault Tolerance Testing](https://docs.nvidia.com/dynamo/v1.4.1/knowledge-base/concepts/fault-tolerance/fault-tolerance-testing.md): Pytest infrastructure for cancellation, migration, etcd high availability, and hardware fault injection.