> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt. # Backends ## Docs - [SGLang](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang.md) - [Reference Guide](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/reference-guide.md): Architecture, configuration, and operational details for the SGLang backend - [SGLang Chat Processor](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/chat-processor.md): SGLang-native preprocessing and postprocessing for chat completions - [Examples](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/examples.md) - [Disaggregation](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/disaggregation.md) - [Diffusion](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/diffusion.md) - [Observability](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/observability.md) - [SGLang for Agentic Workloads](https://docs.nvidia.com/dynamo/v1.0.0/backends/sg-lang/agentic-workloads.md): Priority scheduling, KV cache eviction policies, and cache pinning for multi-turn agentic serving - [TensorRT-LLM](https://docs.nvidia.com/dynamo/v1.0.0/backends/tensor-rt-llm.md) - [Reference Guide](https://docs.nvidia.com/dynamo/v1.0.0/backends/tensor-rt-llm/reference-guide.md): Features, configuration, and operational details for the TensorRT-LLM backend - [Examples](https://docs.nvidia.com/dynamo/v1.0.0/backends/tensor-rt-llm/examples.md) - [Prometheus](https://docs.nvidia.com/dynamo/v1.0.0/backends/tensor-rt-llm/prometheus-metrics.md) - [Video Diffusion Support (Experimental)](https://docs.nvidia.com/dynamo/v1.0.0/backends/tensor-rt-llm/video-diffusion-experimental.md) - [Known Issues and Mitigations](https://docs.nvidia.com/dynamo/v1.0.0/backends/tensor-rt-llm/known-issues-and-mitigations.md) - [vLLM](https://docs.nvidia.com/dynamo/v1.0.0/backends/v-llm.md)