Rust API

Published Dynamo crates with release-pinned docs.rs links.

Dynamo publishes 12 Rust crates for release 1.4.0.

dynamo-kv-router

KV-aware request routing library

LLM inference engine

Memory management utilities

Core distributed runtime library

Logical layer for the KV Block Manager

Configuration management

Protocol parsers (SSE, JSON streaming)

dynamo-protocols

Async OpenAI-compatible API client

dynamo-tokenizers

Tokenizer library for LLM inference

Tokenizer bindings for LLM inference

Inference engine simulator for benchmarking

dynamo-async-openai

Legacy OpenAI client; use dynamo-protocols

Core Crates

Crate	Summary	Version	Install
`dynamo-kv-router`	KV-aware request routing library	`1.4.0`	`cargo add dynamo-kv-router@1.4.0`
`dynamo-llm`	LLM inference engine	`1.4.0`	`cargo add dynamo-llm@1.4.0`
`dynamo-memory`	Memory management utilities	`1.4.0`	`cargo add dynamo-memory@1.4.0`
`dynamo-runtime`	Core distributed runtime library	`1.4.0`	`cargo add dynamo-runtime@1.4.0`
`kvbm-logical`	Logical layer for the KV Block Manager	`1.4.0`	`cargo add kvbm-logical@1.4.0`

Supporting Crates

Crate	Summary	Version	Install
`dynamo-config`	Configuration management	`1.2.1`	`cargo add dynamo-config@1.2.1`
`dynamo-parsers`	Protocol parsers (SSE, JSON streaming)	`7.0.1`	`cargo add dynamo-parsers@7.0.1`
`dynamo-protocols`	Async OpenAI-compatible API client	`5.0.1`	`cargo add dynamo-protocols@5.0.1`
`dynamo-tokenizers`	Tokenizer library for LLM inference	`1.5.4`	`cargo add dynamo-tokenizers@1.5.4`
`dynamo-tokens`	Tokenizer bindings for LLM inference	`1.4.0`	`cargo add dynamo-tokens@1.4.0`

Development and Testing

Crate	Summary	Version	Install
`dynamo-mocker`	Inference engine simulator for benchmarking	`1.4.0`	`cargo add dynamo-mocker@1.4.0`

Deprecated Crates

Crate	Summary	Version	Install
`dynamo-async-openai`	Legacy OpenAI client; use dynamo-protocols	`1.0.2`	`cargo add dynamo-async-openai@1.0.2`

Language Bindings

Binding	Language	Summary	Source
`dynamo-codegen`	Python	PyO3 code generation for the dynamo._core module.	`lib/bindings/python/codegen`
`libdynamo_llm`	C	C bindings for the Dynamo LLM library.	`lib/bindings/c`