> This page is for NeMo Relay, version dev.
> For other versions, use one of these documentation indexes:
> - Latest (v0.11.1) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
> - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
> - v0.11.1: https://docs.nvidia.com/nemo/relay/v0.11.1/llms.txt
> - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt
> - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
> - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
> - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# nemo-relay-runtime

> Runtime execution, registries, scopes, and continuation handling for NeMo Relay. Component implementations are supplied by the embedding SDK or application.

Generated from `cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

Runtime execution, registries, scopes, and continuation handling for NeMo Relay. Component implementations are supplied by the embedding SDK or application.

## Modules

* [api](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api): Public API for the NeMo Relay runtime.
* [codec](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/codec): Runtime normalization composes provider codecs with the configured pricing service.
* [composition](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/composition): Services supplied by the SDK or an embedding application. Component services supplied by plugin-host or an embedding application.
* [config_editor](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor): Shared configuration editor metadata.
* [error](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/error): Shared runtime errors, preserved at the core import path.
* [json](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/json): JSON utilities for the NeMo Relay runtime.
* [pricing](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/pricing): Runtime pricing service adapters. Host-supplied model pricing without a dependency on a pricing implementation.
* [registry](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/registry): Priority-sorted named registry.
* [stream](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/stream): Streaming LLM response wrapper.

## Macros

* [editor_config](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/macro-editor-config): Declare typed configuration editor metadata. Implements [`EditorConfig`](/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/trait-editorconfig) for a configuration type.