Skip to navigation
ReferenceAPIsRust Library Reference

nemo-relay-runtime

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Runtime execution, registries, scopes, and continuation handling for NeMo Relay. Component implementations are supplied by the embedding SDK or application.

Modules

  • api: Public API for the NeMo Relay runtime.
  • codec: Runtime normalization composes provider codecs with the configured pricing service.
  • composition: Services supplied by the SDK or an embedding application. Component services supplied by plugin-host or an embedding application.
  • config_editor: Shared configuration editor metadata.
  • error: Shared runtime errors, preserved at the core import path.
  • json: JSON utilities for the NeMo Relay runtime.
  • pricing: Runtime pricing service adapters. Host-supplied model pricing without a dependency on a pricing implementation.
  • registry: Priority-sorted named registry.
  • stream: Streaming LLM response wrapper.

Macros