Support Matrix

See also: Release Artifacts for container images, wheels, Helm charts, and crates | Feature Matrix for backend feature support

At a Glance

Latest stable release: v1.0.0 — SGLang 0.5.9 | TensorRT-LLM 1.3.0rc5.post1 | vLLM 0.16.0 | NIXL 0.10.1

On this page: Backend Dependencies | CUDA and Drivers | Hardware | Platform | Cloud | Build Support

Backend Dependencies

The following table shows the backend framework versions included with each Dynamo release:

Version Labels

• main (ToT) reflects the current development branch.
• Releases marked (in progress) or (planned) show target versions that may change before final release.

Version Compatibility

• Backend versions listed are the only versions tested and supported for each release.
• TensorRT-LLM does not support Python 3.11; installation of the ai-dynamo[trtllm] wheel will fail on Python 3.11.

CUDA and Driver Requirements

Dynamo container images include CUDA toolkit libraries. The host machine must have a compatible NVIDIA GPU driver installed.

Patch versions (e.g., v0.8.1.post1, v0.7.0.post1) have the same CUDA support as their base version.

Experimental CUDA 13 images are not published for all versions. Check Release Artifacts for availability.

For detailed artifact versions and NGC links (including container images, Python wheels, Helm charts, and Rust crates), see the Release Artifacts page.

CUDA Compatibility Resources

For detailed information on CUDA driver compatibility, forward compatibility, and troubleshooting:

• CUDA Compatibility Overview
• Why CUDA Compatibility
• Minor Version Compatibility
• Forward Compatibility
• FAQ

For extended driver compatibility beyond the minimum versions listed above, consider using cuda-compat packages on the host. See Forward Compatibility for details.

Hardware Compatibility

Dynamo provides multi-arch container images supporting both AMD64 (x86_64) and ARM64 architectures. See Release Artifacts for available images.

GPU Compatibility

If you are using a GPU, the following GPU models and architectures are supported:

Platform Architecture Compatibility

Dynamo is compatible with the following platforms:

Wheels are built using a manylinux_2_28-compatible environment and validated on CentOS Stream 9 and Ubuntu (22.04, 24.04). Compatibility with other Linux distributions is expected but not officially verified.

Cloud Service Provider Compatibility

AWS

Build Support

For version-specific artifact details, installation commands, and release history, see Release Artifacts.

Dynamo currently provides build support in the following ways:

• Wheels: We distribute Python wheels of Dynamo and KV Block Manager:

  • ai-dynamo
  • ai-dynamo-runtime
  • kvbm as a standalone implementation.

• Dynamo Container Images: We distribute multi-arch images (x86 & ARM64 compatible) on NGC:

  • Dynamo Frontend (New in v0.8.0)
  • SGLang Runtime
  • SGLang Runtime (CUDA 13)
  • TensorRT-LLM Runtime
  • TensorRT-LLM Runtime (EFA) (New in v1.0.0, Experimental, AMD64 only)
  • vLLM Runtime
  • vLLM Runtime (CUDA 13)
  • vLLM Runtime (EFA) (New in v1.0.0, Experimental, AMD64 only)
  • Kubernetes Operator
  • Snapshot Agent (New in v1.0.0, Preview)

• Helm Charts: NGC hosts the helm charts supporting Kubernetes deployments of Dynamo:

  • Dynamo Platform (now includes CRDs)
  • Snapshot (New in v1.0.0, Preview)
  • Dynamo CRDs (Deprecated in v1.0.0, CRDs managed by Operator)
  • Dynamo Graph (Deprecated in v0.9.0)

• Rust Crates:

  • dynamo-runtime
  • dynamo-llm
  • dynamo-async-openai
  • dynamo-parsers
  • dynamo-config (New in v0.8.0)
  • dynamo-memory (New in v0.8.0)
  • dynamo-tokens (New in v0.9.0)
  • dynamo-mocker (New in v1.0.0)
  • dynamo-kv-router (New in v1.0.0)

Once you’ve confirmed that your platform and architecture are compatible, you can install Dynamo by following the Local Quick Start in the README.