> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# Fault Tolerance

## Docs

- [Request Migration Architecture](https://docs.nvidia.com/dynamo/v1.4.0/knowledge-base/concepts/fault-tolerance/request-migration-architecture.md): Preserve token state and reissue in-flight requests on healthy workers after a worker failure.
- [Request Cancellation Architecture](https://docs.nvidia.com/dynamo/v1.4.0/knowledge-base/concepts/fault-tolerance/request-cancellation-architecture.md): Cancel in-flight work across the Frontend and workers when a client disconnects.
- [Request Rejection Architecture](https://docs.nvidia.com/dynamo/v1.4.0/knowledge-base/concepts/fault-tolerance/request-rejection-architecture.md): Worker-load event processing, busy-state aggregation, overload errors, and hard worker admission limits.
- [Graceful Shutdown Architecture](https://docs.nvidia.com/dynamo/v1.4.0/knowledge-base/concepts/fault-tolerance/graceful-shutdown-architecture.md)
- [Fault Tolerance Testing](https://docs.nvidia.com/dynamo/v1.4.0/knowledge-base/concepts/fault-tolerance/fault-tolerance-testing.md): Pytest infrastructure for cancellation, migration, etcd high availability, and hardware fault injection.