This page is for version v1.4.2.
For other versions, use one of these documentation indexes:
- Latest (v1.5.1) (default): https://docs.nvidia.com/dynamo/latest/llms.txt
- dev: https://docs.nvidia.com/dynamo/dev/llms.txt
- v1.5.1: https://docs.nvidia.com/dynamo/v1.5.1/llms.txt
- v1.5.0: https://docs.nvidia.com/dynamo/v1.5.0/llms.txt
- v1.4.2: https://docs.nvidia.com/dynamo/v1.4.2/llms.txt
- v1.4.1: https://docs.nvidia.com/dynamo/v1.4.1/llms.txt
- v1.4.0: https://docs.nvidia.com/dynamo/v1.4.0/llms.txt
- v1.3.0: https://docs.nvidia.com/dynamo/v1.3.0/llms.txt
- v1.2.1: https://docs.nvidia.com/dynamo/v1.2.1/llms.txt
- v1.2.0: https://docs.nvidia.com/dynamo/v1.2.0/llms.txt
- v1.1.1: https://docs.nvidia.com/dynamo/v1.1.1/llms.txt
- v1.1.0: https://docs.nvidia.com/dynamo/v1.1.0/llms.txt
- v1.0.2: https://docs.nvidia.com/dynamo/v1.0.2/llms.txt
- v1.0.1: https://docs.nvidia.com/dynamo/v1.0.1/llms.txt
- v1.0.0: https://docs.nvidia.com/dynamo/v1.0.0/llms.txt
- v0.9.1: https://docs.nvidia.com/dynamo/v-0-9-1/llms.txt
- v0.9.0: https://docs.nvidia.com/dynamo/v-0-9-0/llms.txt
- v0.8.1: https://docs.nvidia.com/dynamo/v-0-8-1/llms.txt
- v0.8.0: https://docs.nvidia.com/dynamo/v-0-8-0/llms.txt
- v0.7.1: https://docs.nvidia.com/dynamo/v-0-7-1/llms.txt
- v0.7.0: https://docs.nvidia.com/dynamo/v-0-7-0/llms.txt
Dynamo publishes 12 Rust crates for release 1.4.0.
dynamo-kv-router
KV-aware request routing library
dynamo-llm
LLM inference engine
dynamo-memory
Memory management utilities
dynamo-runtime
Core distributed runtime library
kvbm-logical
Logical layer for the KV Block Manager
dynamo-config
Configuration management
dynamo-parsers
Protocol parsers (SSE, JSON streaming)
dynamo-protocols
Async OpenAI-compatible API client
dynamo-tokenizers
Tokenizer library for LLM inference
dynamo-tokens
Tokenizer bindings for LLM inference
dynamo-mocker
Inference engine simulator for benchmarking
dynamo-async-openai
Legacy OpenAI client; use dynamo-protocols
Core Crates
| Crate | Summary | Version | Install |
|---|---|---|---|
dynamo-kv-router | KV-aware request routing library | 1.4.0 | cargo add dynamo-kv-router@1.4.0 |
dynamo-llm | LLM inference engine | 1.4.0 | cargo add dynamo-llm@1.4.0 |
dynamo-memory | Memory management utilities | 1.4.0 | cargo add dynamo-memory@1.4.0 |
dynamo-runtime | Core distributed runtime library | 1.4.0 | cargo add dynamo-runtime@1.4.0 |
kvbm-logical | Logical layer for the KV Block Manager | 1.4.0 | cargo add kvbm-logical@1.4.0 |
Supporting Crates
| Crate | Summary | Version | Install |
|---|---|---|---|
dynamo-config | Configuration management | 1.2.1 | cargo add dynamo-config@1.2.1 |
dynamo-parsers | Protocol parsers (SSE, JSON streaming) | 7.0.1 | cargo add dynamo-parsers@7.0.1 |
dynamo-protocols | Async OpenAI-compatible API client | 5.0.1 | cargo add dynamo-protocols@5.0.1 |
dynamo-tokenizers | Tokenizer library for LLM inference | 1.5.4 | cargo add dynamo-tokenizers@1.5.4 |
dynamo-tokens | Tokenizer bindings for LLM inference | 1.4.0 | cargo add dynamo-tokens@1.4.0 |
Development and Testing
| Crate | Summary | Version | Install |
|---|---|---|---|
dynamo-mocker | Inference engine simulator for benchmarking | 1.4.0 | cargo add dynamo-mocker@1.4.0 |
Deprecated Crates
| Crate | Summary | Version | Install |
|---|---|---|---|
dynamo-async-openai | Legacy OpenAI client; use dynamo-protocols | 1.0.2 | cargo add dynamo-async-openai@1.0.2 |
Language Bindings
| Binding | Language | Summary | Source |
|---|---|---|---|
dynamo-codegen | Python | PyO3 code generation for the dynamo._core module. | lib/bindings/python/codegen |
libdynamo_llm | C | C bindings for the Dynamo LLM library. | lib/bindings/c |