Additional ResourcesTemplates

Integration README

View as Markdown

Version Compatibility

Dynamo<Integration>Notes
0.9.x1.2.xRecommended
0.8.x1.1.x

Backend Support

BackendStatusNotes
vLLM
SGLang🚧
TensorRT-LLM

Quick Start

$# Add installation and usage from existing integration docs
$# Example pattern (LMCache):
$# python -m dynamo.vllm --model <model> --kv-transfer-config '{"kv_connector":"LMCacheMPConnector","kv_role":"kv_both"}'

Configuration

ParameterDefaultDescription

Guides

DocumentPathDescription
<Integration> Setup<integration>_setup.mdInstallation and configuration
<Integration> with vLLM<integration>_vllm.mdvLLM-specific usage

External Resources