> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# vLLM

## Docs

- [vLLM](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/overview.md)
- [vLLM Sidecar](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/sidecar.md): Run Dynamo beside a stock vLLM engine through native gRPC.
- [Reference Guide](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/reference-guide.md): Configuration, arguments, and operational details for the vLLM backend
- [vLLM Chat Processor](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/chat-processor.md): vLLM-native preprocessing and postprocessing for chat completions
- [KV Cache Offloading](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/kv-cache-offloading.md): CPU and disk offloading integrations for vLLM in Dynamo
- [Native KV Offloading](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/native-kv-offloading.md): vLLM's OffloadingConnector with KV-aware routing in Dynamo
- [vLLM Observability](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/observability.md): vLLM exposes request, latency, scheduler, and disaggregation metrics through Dynamo's Prometheus /metrics endpoint.
- [vLLM Multimodal](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/vllm-multimodal.md)
- [vLLM-Omni Disaggregated Multi-Stage Serving](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/v-llm/v-llm-omni-disaggregated-serving.md): Architecture of multi-stage vLLM-Omni pipelines (e.g. AR + Diffusion), with each stage on its own GPU for independent scaling and isolation.