> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# Fault Tolerance

## Docs

- [Fault Tolerance Overview](https://docs.nvidia.com/dynamo/v1.4.0/kubernetes/fault-tolerance/overview.md): Choose request-level and worker-level recovery behaviors for production Dynamo deployments.
- [Request Migration](https://docs.nvidia.com/dynamo/v1.4.0/kubernetes/fault-tolerance/request-migration.md): Keep in-flight generations alive across worker failures by retrying them on a healthy worker.
- [Request Rejection](https://docs.nvidia.com/dynamo/v1.4.0/kubernetes/fault-tolerance/request-rejection.md): Configure independent load thresholds that shed traffic with HTTP 529 before worker latency or memory use becomes unsafe.
- [Graceful Shutdown](https://docs.nvidia.com/dynamo/v1.4.0/kubernetes/fault-tolerance/graceful-shutdown.md): Let workers finish in-flight requests and release resources cleanly when a pod is terminated.
- [Shadow Engine Failover](https://docs.nvidia.com/dynamo/v1.4.0/kubernetes/fault-tolerance/shadow-engine-failover.md): Keeps a standby engine attached to GPU-resident model weights so process failures recover without reloading the model.