> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# SGLang

## Docs

- [SGLang](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/overview.md): SGLang engines run in Dynamo's distributed runtime with disaggregated serving, KV-aware routing, and request cancellation.
- [SGLang Sidecar](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/sidecar.md): Run Dynamo beside a stock SGLang engine through native gRPC.
- [Reference Guide](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/reference-guide.md): Architecture, configuration, and operational details for the SGLang backend
- [SGLang for Agentic Workloads](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/agents-on-sg-lang.md): Priority scheduling and session control for multi-turn agentic serving
- [SGLang Chat Processor](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/chat-processor.md): SGLang-native preprocessing and postprocessing for chat completions
- [Disaggregation](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/disaggregation.md): SGLang runs prefill and decode as separate workers in Dynamo, coordinated by a bootstrap handshake with RDMA-based KV cache transfer.
- [Using HiCache](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/hi-cache.md): Hierarchical KV caching with tier-aware router integration
- [Observability](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/observability.md): Prometheus metrics, forward pass telemetry, distributed tracing, and Grafana dashboards for SGLang workers in Dynamo.
- [SGLang Multimodal](https://docs.nvidia.com/dynamo/v1.4.2/knowledge-base/modular-components/backends/sg-lang/sglang-multimodal.md)