> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://docs.nvidia.com/dynamo/llms.txt. For full content including API reference and SDK examples, see https://docs.nvidia.com/dynamo/llms-full.txt.

# Rust API

Dynamo publishes 12 Rust crates for release `1.3.1`.

#### [dynamo-kv-router](https://docs.rs/dynamo-kv-router/1.3.1)

KV-aware request routing library

#### [dynamo-llm](https://docs.rs/dynamo-llm/1.3.1)

LLM inference engine

#### [dynamo-memory](https://docs.rs/dynamo-memory/1.3.1)

Memory management utilities

#### [dynamo-runtime](https://docs.rs/dynamo-runtime/1.3.1)

Core distributed runtime library

#### [kvbm-logical](https://docs.rs/kvbm-logical/1.3.1)

Logical layer for the KV Block Manager

#### [dynamo-config](https://docs.rs/dynamo-config/1.2.1)

Configuration management

#### [dynamo-parsers](https://docs.rs/dynamo-parsers/1.3.0)

Protocol parsers (SSE, JSON streaming)

#### [dynamo-protocols](https://docs.rs/dynamo-protocols/1.3.0)

Async OpenAI-compatible API client

#### [dynamo-tokenizers](https://docs.rs/dynamo-tokenizers/1.3.1)

Tokenizer library for LLM inference

#### [dynamo-tokens](https://docs.rs/dynamo-tokens/1.3.1)

Tokenizer bindings for LLM inference

#### [dynamo-mocker](https://docs.rs/dynamo-mocker/1.3.1)

Inference engine simulator for benchmarking

#### [dynamo-async-openai](https://docs.rs/dynamo-async-openai/1.0.2)

Legacy OpenAI client; use dynamo-protocols

## Core Crates

| Crate                                                        | Summary                                | Version | Install                            |
| ------------------------------------------------------------ | -------------------------------------- | ------- | ---------------------------------- |
| [`dynamo-kv-router`](https://docs.rs/dynamo-kv-router/1.3.1) | KV-aware request routing library       | `1.3.1` | `cargo add dynamo-kv-router@1.3.1` |
| [`dynamo-llm`](https://docs.rs/dynamo-llm/1.3.1)             | LLM inference engine                   | `1.3.1` | `cargo add dynamo-llm@1.3.1`       |
| [`dynamo-memory`](https://docs.rs/dynamo-memory/1.3.1)       | Memory management utilities            | `1.3.1` | `cargo add dynamo-memory@1.3.1`    |
| [`dynamo-runtime`](https://docs.rs/dynamo-runtime/1.3.1)     | Core distributed runtime library       | `1.3.1` | `cargo add dynamo-runtime@1.3.1`   |
| [`kvbm-logical`](https://docs.rs/kvbm-logical/1.3.1)         | Logical layer for the KV Block Manager | `1.3.1` | `cargo add kvbm-logical@1.3.1`     |

## Supporting Crates

| Crate                                                          | Summary                                | Version | Install                             |
| -------------------------------------------------------------- | -------------------------------------- | ------- | ----------------------------------- |
| [`dynamo-config`](https://docs.rs/dynamo-config/1.2.1)         | Configuration management               | `1.2.1` | `cargo add dynamo-config@1.2.1`     |
| [`dynamo-parsers`](https://docs.rs/dynamo-parsers/1.3.0)       | Protocol parsers (SSE, JSON streaming) | `1.3.0` | `cargo add dynamo-parsers@1.3.0`    |
| [`dynamo-protocols`](https://docs.rs/dynamo-protocols/1.3.0)   | Async OpenAI-compatible API client     | `1.3.0` | `cargo add dynamo-protocols@1.3.0`  |
| [`dynamo-tokenizers`](https://docs.rs/dynamo-tokenizers/1.3.1) | Tokenizer library for LLM inference    | `1.3.1` | `cargo add dynamo-tokenizers@1.3.1` |
| [`dynamo-tokens`](https://docs.rs/dynamo-tokens/1.3.1)         | Tokenizer bindings for LLM inference   | `1.3.1` | `cargo add dynamo-tokens@1.3.1`     |

## Development and Testing

| Crate                                                  | Summary                                     | Version | Install                         |
| ------------------------------------------------------ | ------------------------------------------- | ------- | ------------------------------- |
| [`dynamo-mocker`](https://docs.rs/dynamo-mocker/1.3.1) | Inference engine simulator for benchmarking | `1.3.1` | `cargo add dynamo-mocker@1.3.1` |

## Deprecated Crates

| Crate                                                              | Summary                                    | Version | Install                               |
| ------------------------------------------------------------------ | ------------------------------------------ | ------- | ------------------------------------- |
| [`dynamo-async-openai`](https://docs.rs/dynamo-async-openai/1.0.2) | Legacy OpenAI client; use dynamo-protocols | `1.0.2` | `cargo add dynamo-async-openai@1.0.2` |

## Language Bindings

| Binding          | Language | Summary                                            | Source                                                                                                     |
| ---------------- | -------- | -------------------------------------------------- | ---------------------------------------------------------------------------------------------------------- |
| `dynamo-codegen` | Python   | PyO3 code generation for the dynamo.\_core module. | [`lib/bindings/python/codegen`](https://github.com/ai-dynamo/dynamo/tree/main/lib/bindings/python/codegen) |
| `libdynamo_llm`  | C        | C bindings for the Dynamo LLM library.             | [`lib/bindings/c`](https://github.com/ai-dynamo/dynamo/tree/main/lib/bindings/c)                           |