> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# v0.9.0

## Docs

- [Quickstart](https://docs.nvidia.com/dynamo/v-0-9-0/getting-started/quickstart.md)
- [Support Matrix](https://docs.nvidia.com/dynamo/v-0-9-0/getting-started/support-matrix.md)
- [Feature Matrix](https://docs.nvidia.com/dynamo/v-0-9-0/getting-started/feature-matrix.md)
- [Release Artifacts](https://docs.nvidia.com/dynamo/v-0-9-0/getting-started/release-artifacts.md)
- [Examples](https://docs.nvidia.com/dynamo/v-0-9-0/getting-started/examples.md)
- [Deployment Guide](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide.md)
- [Detailed Installation Guide](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/detailed-installation-guide.md)
- [Dynamo Operator](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/dynamo-operator.md)
- [Service Discovery](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/service-discovery.md)
- [Webhooks](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/webhooks.md)
- [Minikube Setup](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/minikube-setup.md)
- [Managing Models with DynamoModel](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/managing-models-with-dynamo-model.md)
- [Autoscaling](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/autoscaling.md)
- [Inference Gateway (GAIE)](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/deployment-guide/inference-gateway-gaie.md)
- [Metrics](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/observability-k-8-s/metrics.md)
- [Logging](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/observability-k-8-s/logging.md)
- [Operator Metrics](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/observability-k-8-s/operator-metrics.md)
- [Multinode Deployments](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/multinode/multinode-deployments.md)
- [Grove](https://docs.nvidia.com/dynamo/v-0-9-0/kubernetes-deployment/multinode/grove.md)
- [KV Cache Aware Routing](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/kv-cache-aware-routing.md): Enable KV-aware routing using Router for Dynamo deployments
- [Disaggregated Serving](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/disaggregated-serving.md): Find optimal prefill/decode configuration for disaggregated serving deployments
- [KV Cache Offloading](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/kv-cache-offloading.md): Enable KV offloading using KV Block Manager (KVBM) for Dynamo deployments
- [Dynamo Benchmarking Guide](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/dynamo-benchmarking.md): Benchmark and compare performance across Dynamo deployment configurations
- [Multimodality Support](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/multimodality-support.md): Deploy multimodal models with image, video, and audio support in Dynamo
- [SGLang Multimodal](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/multimodality-support/sg-lang-multimodal.md)
- [TensorRT-LLM Multimodal](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/multimodality-support/tensor-rt-llm-multimodal.md)
- [vLLM Multimodal](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/multimodality-support/v-llm-multimodal.md)
- [Tool Calling](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/tool-calling.md): Connect Dynamo to external tools and services using function calling
- [LoRA Adapters](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/lo-ra-adapters.md): Serve fine-tuned LoRA adapters with dynamic loading and routing in Dynamo
- [Observability (Local)](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local.md): Monitor Dynamo deployments with metrics, logging, and tracing
- [Prometheus + Grafana Setup](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local/prometheus-grafana-setup.md)
- [Metrics](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local/metrics.md)
- [Metrics Developer Guide](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local/metrics-developer-guide.md)
- [Health Checks](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local/health-checks.md)
- [Tracing](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local/tracing.md)
- [Logging](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/observability-local/logging.md)
- [Fault Tolerance](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/fault-tolerance.md): Handle failures gracefully with request migration, cancellation, and graceful shutdown
- [Request Migration](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/fault-tolerance/request-migration.md)
- [Request Cancellation](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/fault-tolerance/request-cancellation.md)
- [Graceful Shutdown](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/fault-tolerance/graceful-shutdown.md)
- [Request Rejection](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/fault-tolerance/request-rejection.md)
- [Testing](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/fault-tolerance/testing.md)
- [Writing Python Workers in Dynamo](https://docs.nvidia.com/dynamo/v-0-9-0/user-guides/writing-python-workers-in-dynamo.md): Create custom Python workers and engines for Dynamo
- [SGLang](https://docs.nvidia.com/dynamo/v-0-9-0/components/backends/sg-lang.md)
- [TensorRT-LLM](https://docs.nvidia.com/dynamo/v-0-9-0/components/backends/tensor-rt-llm.md)
- [vLLM](https://docs.nvidia.com/dynamo/v-0-9-0/components/backends/v-llm.md)
- [Frontend](https://docs.nvidia.com/dynamo/v-0-9-0/components/frontend.md)
- [Frontend Guide](https://docs.nvidia.com/dynamo/v-0-9-0/components/frontend/frontend-guide.md)
- [Router](https://docs.nvidia.com/dynamo/v-0-9-0/components/router.md)
- [Router Guide](https://docs.nvidia.com/dynamo/v-0-9-0/components/router/router-guide.md): Enable KV-aware routing using Router for Dynamo deployments
- [Router Examples](https://docs.nvidia.com/dynamo/v-0-9-0/components/router/router-examples.md)
- [Planner](https://docs.nvidia.com/dynamo/v-0-9-0/components/planner.md)
- [Planner Guide](https://docs.nvidia.com/dynamo/v-0-9-0/components/planner/planner-guide.md)
- [Planner Examples](https://docs.nvidia.com/dynamo/v-0-9-0/components/planner/planner-examples.md)
- [Profiler](https://docs.nvidia.com/dynamo/v-0-9-0/components/profiler.md)
- [Profiler Guide](https://docs.nvidia.com/dynamo/v-0-9-0/components/profiler/profiler-guide.md)
- [Profiler Examples](https://docs.nvidia.com/dynamo/v-0-9-0/components/profiler/profiler-examples.md)
- [KVBM](https://docs.nvidia.com/dynamo/v-0-9-0/components/kvbm.md)
- [KVBM Guide](https://docs.nvidia.com/dynamo/v-0-9-0/components/kvbm/kvbm-guide.md): Enable KV offloading using KV Block Manager (KVBM) for Dynamo deployments
- [LMCache](https://docs.nvidia.com/dynamo/v-0-9-0/integrations/lm-cache.md)
- [SGLang HiCache](https://docs.nvidia.com/dynamo/v-0-9-0/integrations/sg-lang-hi-cache.md)
- [FlexKV](https://docs.nvidia.com/dynamo/v-0-9-0/integrations/flex-kv.md)
- [KV Events for Custom Engines](https://docs.nvidia.com/dynamo/v-0-9-0/integrations/kv-events-for-custom-engines.md)
- [Overall Architecture](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/overall-architecture.md)
- [Architecture Flow](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/architecture-flow.md)
- [Disaggregated Serving](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/disaggregated-serving.md)
- [Distributed Runtime](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/distributed-runtime.md)
- [Discovery Plane](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/discovery-plane.md)
- [Request Plane](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/request-plane.md)
- [Event Plane](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/event-plane.md)
- [Router Design](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/router-design.md)
- [KVBM Design](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/kvbm-design.md)
- [Planner Design](https://docs.nvidia.com/dynamo/v-0-9-0/design-docs/planner-design.md)