Rust API

Published Dynamo crates with release-pinned docs.rs links.

Dynamo publishes 12 Rust crates for release 1.3.1.

dynamo-kv-router

KV-aware request routing library

LLM inference engine

Memory management utilities

Core distributed runtime library

Logical layer for the KV Block Manager

Configuration management

Protocol parsers (SSE, JSON streaming)

dynamo-protocols

Async OpenAI-compatible API client

dynamo-tokenizers

Tokenizer library for LLM inference

Tokenizer bindings for LLM inference

Inference engine simulator for benchmarking

dynamo-async-openai

Legacy OpenAI client; use dynamo-protocols

Core Crates

Crate	Summary	Version	Install
`dynamo-kv-router`	KV-aware request routing library	`1.3.1`	`cargo add dynamo-kv-router@1.3.1`
`dynamo-llm`	LLM inference engine	`1.3.1`	`cargo add dynamo-llm@1.3.1`
`dynamo-memory`	Memory management utilities	`1.3.1`	`cargo add dynamo-memory@1.3.1`
`dynamo-runtime`	Core distributed runtime library	`1.3.1`	`cargo add dynamo-runtime@1.3.1`
`kvbm-logical`	Logical layer for the KV Block Manager	`1.3.1`	`cargo add kvbm-logical@1.3.1`

Supporting Crates

Crate	Summary	Version	Install
`dynamo-config`	Configuration management	`1.2.1`	`cargo add dynamo-config@1.2.1`
`dynamo-parsers`	Protocol parsers (SSE, JSON streaming)	`1.3.0`	`cargo add dynamo-parsers@1.3.0`
`dynamo-protocols`	Async OpenAI-compatible API client	`1.3.0`	`cargo add dynamo-protocols@1.3.0`
`dynamo-tokenizers`	Tokenizer library for LLM inference	`1.3.1`	`cargo add dynamo-tokenizers@1.3.1`
`dynamo-tokens`	Tokenizer bindings for LLM inference	`1.3.1`	`cargo add dynamo-tokens@1.3.1`

Development and Testing

Crate	Summary	Version	Install
`dynamo-mocker`	Inference engine simulator for benchmarking	`1.3.1`	`cargo add dynamo-mocker@1.3.1`

Deprecated Crates

Crate	Summary	Version	Install
`dynamo-async-openai`	Legacy OpenAI client; use dynamo-protocols	`1.0.2`	`cargo add dynamo-async-openai@1.0.2`

Language Bindings

Binding	Language	Summary	Source
`dynamo-codegen`	Python	PyO3 code generation for the dynamo._core module.	`lib/bindings/python/codegen`
`libdynamo_llm`	C	C bindings for the Dynamo LLM library.	`lib/bindings/c`