> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server. # nemo-relay > NeMo Relay Core Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`. ## NeMo Relay Core The core runtime library for the NeMo Relay multi-language agent framework. This crate provides execution scope management, lifecycle event tracking, and middleware pipelines (guardrails and intercepts) for tool and LLM calls. ### Architecture The runtime is organized around a **global context** ([`api::runtime::NemoRelayContextState`](/reference/api/rust-library-reference/nemo-relay/api/runtime/state/struct-nemorelaycontextstate)) that holds all registered middleware (guardrails, intercepts, subscribers) and a **scope stack** ([`api::runtime::ScopeStack`](/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/struct-scopestack)) that tracks the hierarchical execution context via task-local or thread-local storage. ### Primary Entry Points Most integrations start with the high-level lifecycle helpers in [`api`](/reference/api/rust-library-reference/nemo-relay/api): * [`api::scope::push_scope`](/reference/api/rust-library-reference/nemo-relay/api/scope/fn-push-scope) / [`api::scope::pop_scope`](/reference/api/rust-library-reference/nemo-relay/api/scope/fn-pop-scope) create nested execution scopes. * [`api::tool::tool_call_execute`](/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call-execute) runs a complete tool middleware pipeline. * [`api::llm::llm_call_execute`](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-execute) and [`api::llm::llm_stream_call_execute`](/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-stream-call-execute) run non-streaming and streaming LLM middleware pipelines. * [`api::registry`](/reference/api/rust-library-reference/nemo-relay/api/registry) exposes global and scope-local middleware registration APIs. * [`api::subscriber`](/reference/api/rust-library-reference/nemo-relay/api/subscriber) exposes lifecycle event subscriber registration APIs. #### Modules * [`api`](/reference/api/rust-library-reference/nemo-relay/api) - Public API functions, handles, lifecycle event types, runtime helpers, and guardrail/intercept/subscriber registration. These are the primary entry points. * [`error`](/reference/api/rust-library-reference/nemo-relay/error) - Error types ([`error::FlowError`](/reference/api/rust-library-reference/nemo-relay/error/enum-flowerror)) and the [`error::Result`](/reference/api/rust-library-reference/nemo-relay/error/type-result) type alias. * [`json`](/reference/api/rust-library-reference/nemo-relay/json) - JSON type alias ([`json::Json`](/reference/api/rust-library-reference/nemo-relay/json/type-json)) and the [`json::merge_json`](/reference/api/rust-library-reference/nemo-relay/json/fn-merge-json) utility. * [`observability`](/reference/api/rust-library-reference/nemo-relay/observability) - Built-in observability backends including [`atif::AtifExporter`](/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifexporter), [`otel::OpenTelemetrySubscriber`](/reference/api/rust-library-reference/nemo-relay/observability/otel/struct-opentelemetrysubscriber), and [`openinference::OpenInferenceSubscriber`](/reference/api/rust-library-reference/nemo-relay/observability/openinference/struct-openinferencesubscriber). * [`stream`](/reference/api/rust-library-reference/nemo-relay/stream) - [`stream::LlmStreamWrapper`](/reference/api/rust-library-reference/nemo-relay/stream/struct-llmstreamwrapper) - a stream adapter that applies per-chunk intercepts and aggregates streaming LLM responses. ### Middleware Pipeline Both tool and LLM calls flow through a configurable middleware pipeline: 1. **Request intercepts** - transform the request before execution 2. **Sanitize request guardrails** - sanitize/normalize the request 3. **Conditional execution guardrails** - gate execution (reject if criteria not met) 4. **Execution intercepts** - optionally replace the execution function entirely 5. **Sanitize response guardrails** - sanitize/normalize the response All middleware is priority-ordered (ascending) and registered by name for easy addition and removal at runtime. ## Modules * [api](/reference/api/rust-library-reference/nemo-relay/api): Public API for the NeMo Relay runtime. * [codec](/reference/api/rust-library-reference/nemo-relay/codec): LLM codec types, traits, and built-in implementations. * [config\_editor](/reference/api/rust-library-reference/nemo-relay/config_editor): Typed configuration editor metadata. * [error](/reference/api/rust-library-reference/nemo-relay/error): Error types for the NeMo Relay runtime. * [json](/reference/api/rust-library-reference/nemo-relay/json): JSON utilities for the NeMo Relay runtime. * [observability](/reference/api/rust-library-reference/nemo-relay/observability): Optional observability integrations for NeMo Relay Core. * [plugin](/reference/api/rust-library-reference/nemo-relay/plugin): Generic plugin infrastructure for NeMo Relay runtimes. * [plugins](/reference/api/rust-library-reference/nemo-relay/plugins): First-party plugin implementations for NeMo Relay Core. * [stream](/reference/api/rust-library-reference/nemo-relay/stream): Streaming LLM response wrapper. ## Macros * [editor\_config](/reference/api/rust-library-reference/nemo-relay/macro-editor-config): Implements [`EditorConfig`](/reference/api/rust-library-reference/nemo-relay/config_editor/trait-editorconfig) for a configuration type. > NeMo Relay Core ## Docs - [Module api](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api.md): Public API for the NeMo Relay runtime. - [Module event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event.md): Lifecycle event types and builder-backed event constructors. Event types for Agent Trajectory Observability Format (ATOF) runtime events. - [Struct Base Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-baseevent.md): Shared event metadata carried by every ATOF event. - [Struct Category Profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-categoryprofile.md): Category-specific profile data. - [Struct Data Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-dataschema.md): Identifier for the schema that describes an event's opaque `data` payload. - [Struct Event Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-eventcategory.md): Semantic category carried by ATOF `category`. - [Struct Mark Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-markevent.md): ATOF point-in-time mark event. - [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner. - [Struct Scope Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-scopeevent.md): ATOF scope lifecycle event. - [Enum Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime. - [Enum Scope Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/enum-scopecategory.md): Agent Trajectory Observability Format (ATOF) lifecycle phase for a scope event. - [Constant ATOF_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/constant-atof-version.md): Agent Trajectory Observability Format (ATOF) protocol version emitted by this runtime. - [Trait Event Normalization Ext](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/trait-eventnormalizationext.md): Core-only normalized LLM accessors for ATOF events. - [Function attributes_from_handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-attributes-from-handle.md): Convert handle bitflags into ATOF attributes. - [Function llm_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-llm-attributes-to-strings.md): Convert LLM bitflags into ATOF attributes. - [Function scope_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-scope-attributes-to-strings.md): Convert scope bitflags into ATOF attributes. - [Function tool_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-tool-attributes-to-strings.md): Convert tool bitflags into ATOF attributes. - [Module llm](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm.md): LLM lifecycle helpers and managed execution entry points. - [Struct Create LlmHandle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-createllmhandleparams.md): Builder parameters for `NemoRelayContextState::create_llm_handle`. - [Struct EndLlm Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-endllmhandleparams.md): Builder parameters for `NemoRelayContextState::build_llm_end_event`. - [Struct LlmAttributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmattributes.md): Bitflags that modify LLM-call behavior and observability. - [Struct LlmCall EndParams](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallendparams.md): Builder parameters for `llm_call_end`. - [Struct LlmCall Execute Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallexecuteparams.md): Builder parameters for `llm_call_execute`. - [Struct LlmCall Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallparams.md): Builder parameters for `llm_call`. - [Struct LlmHandle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmhandle.md): Runtime-owned handle identifying an active or completed LLM call. - [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime. - [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks. - [Struct LlmStream Call Execute Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmstreamcallexecuteparams.md): Builder parameters for `llm_stream_call_execute`. - [Function llm_call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call.md): Start a manual LLM lifecycle span. - [Function llm_call_end](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-end.md): Finish a manual LLM lifecycle span. - [Function llm_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-execute.md): Execute an LLM call through the managed middleware pipeline. - [Function llm_conditional_execution](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-conditional-execution.md): Run only the LLM conditional-execution guardrail chain. - [Function llm_request_intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-request-intercepts.md): Run only the LLM request-intercept chain. - [Function llm_stream_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-stream-call-execute.md): Execute a streaming LLM call through the managed middleware pipeline. - [Module registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry.md): Global and scope-local middleware registration helpers. Middleware registry helpers for global and scope-local guardrails, intercepts, and subscribers. - [Function deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-conditional-execution-guardrail.md): Deregister a global LLM conditional-execution guardrail. - [Function deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-execution-intercept.md): Deregister a global LLM execution intercept. - [Function deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-request-intercept.md): Deregister a global LLM request intercept. - [Function deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-sanitize-request-guardrail.md): Deregister a global LLM sanitize-request guardrail. - [Function deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-sanitize-response-guardrail.md): Deregister a global LLM sanitize-response guardrail. - [Function deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-stream-execution-intercept.md): Deregister a global streaming LLM execution intercept. - [Function deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-conditional-execution-guardrail.md): Deregister a global tool conditional-execution guardrail. - [Function deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-execution-intercept.md): Deregister a global tool execution intercept. - [Function deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-request-intercept.md): Deregister a global tool request intercept. - [Function deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-sanitize-request-guardrail.md): Deregister a global tool sanitize-request guardrail. - [Function deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-sanitize-response-guardrail.md): Deregister a global tool sanitize-response guardrail. - [Function register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-conditional-execution-guardrail.md): Register a global LLM conditional-execution guardrail. The guardrail can block LLM execution before intercepts or the provider callback run. - [Function register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-execution-intercept.md): Register a global LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback. - [Function register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-request-intercept.md): Register a global LLM request intercept. Request intercepts can rewrite or annotate the outgoing LLM request and schedule lifecycle marks for the resulting LLM scope. - [Function register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-sanitize-request-guardrail.md): Register a global LLM sanitize-request guardrail. The guardrail rewrites only the request payload recorded on emitted start events. - [Function register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-sanitize-response-guardrail.md): Register a global LLM sanitize-response guardrail. The guardrail rewrites only the response payload recorded on emitted end events. - [Function register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-stream-execution-intercept.md): Register a global streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback. - [Function register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-conditional-execution-guardrail.md): Register a global tool conditional-execution guardrail. The guardrail can block tool execution before intercepts or the tool callback run. - [Function register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-execution-intercept.md): Register a global tool execution intercept. Execution intercepts can wrap or replace the tool callback. Each callback returns a canonical tool execution outcome, while its continuation resolves to the raw downstream result JSON. - [Function register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-request-intercept.md): Register a global tool request intercept. Request intercepts can rewrite tool arguments before execution. - [Function register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-sanitize-request-guardrail.md): Register a global tool sanitize-request guardrail. The guardrail rewrites only the tool input recorded on emitted start events. - [Function register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-sanitize-response-guardrail.md): Register a global tool sanitize-response guardrail. The guardrail rewrites only the tool output recorded on emitted end events. - [Function scope_deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-conditional-execution-guardrail.md): Deregister a scope-local LLM conditional-execution guardrail. - [Function scope_deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-execution-intercept.md): Deregister a scope-local LLM execution intercept. - [Function scope_deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-request-intercept.md): Deregister a scope-local LLM request intercept. - [Function scope_deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-sanitize-request-guardrail.md): Deregister a scope-local LLM sanitize-request guardrail. - [Function scope_deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-sanitize-response-guardrail.md): Deregister a scope-local LLM sanitize-response guardrail. - [Function scope_deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-stream-execution-intercept.md): Deregister a scope-local streaming LLM execution intercept. - [Function scope_deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-conditional-execution-guardrail.md): Deregister a scope-local tool conditional-execution guardrail. - [Function scope_deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-execution-intercept.md): Deregister a scope-local tool execution intercept. - [Function scope_deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-request-intercept.md): Deregister a scope-local tool request intercept. - [Function scope_deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-sanitize-request-guardrail.md): Deregister a scope-local tool sanitize-request guardrail. - [Function scope_deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-sanitize-response-guardrail.md): Deregister a scope-local tool sanitize-response guardrail. - [Function scope_register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-conditional-execution-guardrail.md): Register a scope-local LLM conditional-execution guardrail. The guardrail can block LLM execution inside the owning scope. - [Function scope_register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-execution-intercept.md): Register a scope-local LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback inside the owning scope. - [Function scope_register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-request-intercept.md): Register a scope-local LLM request intercept. Request intercepts can rewrite or annotate LLM requests inside the owning scope and schedule lifecycle marks for the resulting LLM scope. - [Function scope_register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-sanitize-request-guardrail.md): Register a scope-local LLM sanitize-request guardrail. The guardrail rewrites only request payloads emitted under the owning scope. - [Function scope_register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-sanitize-response-guardrail.md): Register a scope-local LLM sanitize-response guardrail. The guardrail rewrites only response payloads emitted under the owning scope. - [Function scope_register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-stream-execution-intercept.md): Register a scope-local streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback inside the owning scope. - [Function scope_register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-conditional-execution-guardrail.md): Register a scope-local tool conditional-execution guardrail. The guardrail can block tool execution inside the owning scope. - [Function scope_register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-execution-intercept.md): Register a scope-local tool execution intercept. Execution intercepts can wrap or replace the tool callback inside the owning scope. Each callback returns a canonical tool execution outcome, while its continuation resolves to the raw downstream result JSON. - [Function scope_register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-request-intercept.md): Register a scope-local tool request intercept. Request intercepts can rewrite tool arguments inside the owning scope. - [Function scope_register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-sanitize-request-guardrail.md): Register a scope-local tool sanitize-request guardrail. The guardrail rewrites only tool input emitted under the owning scope. - [Function scope_register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-sanitize-response-guardrail.md): Register a scope-local tool sanitize-response guardrail. The guardrail rewrites only tool output emitted under the owning scope. - [Module runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime.md): Advanced runtime state, callbacks, and scope-stack helpers. Advanced runtime state, callbacks, and scope-stack helpers. - [Module callbacks](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks.md): Callback type aliases used by the runtime middleware pipeline. - [Type Alias Event Subscriber Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-eventsubscriberfn.md): Consume runtime lifecycle events after they are emitted. - [Type Alias LlmCollector Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmcollectorfn.md): Per-chunk collector used by the streaming LLM runtime. - [Type Alias LlmConditional Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmconditionalfn.md): Decide whether an LLM call is allowed to continue. - [Type Alias LlmExecution Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmexecutionfn.md): Wrap or replace non-streaming LLM execution. - [Type Alias LlmExecution Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmexecutionnextfn.md): Continuation type invoked by non-streaming LLM execution intercepts. - [Type Alias LlmFinalizer Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmfinalizerfn.md): Finalizer used to synthesize the aggregate streaming response payload. - [Type Alias LlmJson Stream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmjsonstream.md): Stream of JSON chunks produced by the managed streaming LLM pipeline. - [Type Alias LlmRequest Intercept Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmrequestinterceptfn.md): Rewrite or annotate an LLM request before execution. - [Type Alias LlmSanitize Request Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmsanitizerequestfn.md): Sanitize an LLM request before the runtime records it. - [Type Alias LlmSanitize Response Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmsanitizeresponsefn.md): Sanitize an LLM response before the runtime records it. - [Type Alias LlmStream Execution Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmstreamexecutionfn.md): Wrap or replace streaming LLM execution. - [Type Alias LlmStream Execution Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmstreamexecutionnextfn.md): Continuation type invoked by streaming LLM execution intercepts. - [Type Alias Tool Conditional Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolconditionalfn.md): Decide whether a tool call is allowed to continue. - [Type Alias Tool Execution Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolexecutionfn.md): Wrap or replace tool execution. - [Type Alias Tool Execution Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolexecutionnextfn.md): Continuation type invoked by tool execution intercepts. - [Type Alias Tool Intercept Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolinterceptfn.md): Rewrite tool arguments before execution. - [Type Alias Tool Sanitize Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolsanitizefn.md): Sanitize a tool request payload before the runtime records it. - [Module global](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/global.md): Process-global access to the shared runtime context state. - [Function global_context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/global/fn-global-context.md): Return the process-global runtime context state handle. - [Module scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack.md): Scope stack storage and propagation helpers. - [Struct Scope Stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/struct-scopestack.md): Mutable stack of active scopes plus their scope-local registries. - [Struct Thread Scope Stack Binding](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/struct-threadscopestackbinding.md): Captured thread-local scope stack binding. - [Static TASK_SCOPE_STACK](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/static-task-scope-stack.md): Task-local scope stack handle used by async execution contexts. - [Function capture_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-capture-thread-scope-stack.md): Capture the current thread-local scope stack binding. - [Function create_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-create-scope-stack.md): Create a new scope stack handle with an implicit root scope. - [Function current_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-current-scope-stack.md): Return the scope stack visible to the current execution context. - [Function propagate_scope_to_thread](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-propagate-scope-to-thread.md): Capture the current scope stack handle for use in another thread. - [Function restore_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-restore-thread-scope-stack.md): Restore a previously captured thread-local scope stack binding. - [Function scope_stack_active](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-scope-stack-active.md): Report whether the current context has an explicitly active scope stack. - [Function set_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-set-thread-scope-stack.md): Install an explicit scope stack for the current thread. - [Function sync_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-sync-thread-scope-stack.md): Synchronize the thread-local scope stack without marking it explicit. - [Function task_scope_push](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-task-scope-push.md): Push a scope handle onto the active stack. - [Function task_scope_remove](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-task-scope-remove.md): Remove a scope handle from the active stack. - [Function task_scope_top](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-task-scope-top.md): Clone the current top-most scope handle from the active stack. - [Function with_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-with-scope-stack.md): Run a synchronous callback with `handle` as the visible scope stack. - [Type Alias Scope Stack Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/type-scopestackhandle.md): Shared handle type for the runtime scope stack. - [Module state](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/state.md): Process-global runtime state and middleware-chain builders. - [Struct Nemo Relay Context State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/state/struct-nemorelaycontextstate.md): Process-global runtime state backing middleware and event emission. - [Module subscriber_dispatcher](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/subscriber_dispatcher.md): Asynchronous subscriber delivery for native targets. - [Function flush_subscribers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/subscriber_dispatcher/fn-flush-subscribers.md): Wait for all queued subscriber callbacks submitted before this call. - [Module scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope.md): Scope stack lifecycle and mark-event entry points. - [Struct Create Scope Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-createscopehandleparams.md): Builder parameters for `NemoRelayContextState::create_scope_handle`. - [Struct Emit Mark Event Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-emitmarkeventparams.md): Builder parameters for `event`. - [Struct EndScope Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-endscopehandleparams.md): Builder parameters for `NemoRelayContextState::build_scope_end_event`. - [Struct PopScope Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-popscopeparams.md): Builder parameters for `pop_scope`. - [Struct Push Scope Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-pushscopeparams.md): Builder parameters for `push_scope`. - [Struct Scope Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-scopeattributes.md): Bitflags that modify scope behavior and observability. - [Struct Scope Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-scopehandle.md): Runtime-owned handle identifying an active or completed scope. - [Enum Handle Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/enum-handleattributes.md): Attribute bitflags attached to a concrete handle kind. - [Enum Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/enum-scopetype.md): Semantic category attached to a scope lifecycle span. - [Function event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-event.md): Emit a standalone mark event under the current or provided scope. - [Function get_handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-get-handle.md): Return the current scope at the top of the active stack. - [Function pop_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-pop-scope.md): Pop the current scope from the active scope stack. - [Function push_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-push-scope.md): Push a new scope onto the active scope stack. - [Module subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber.md): Global and scope-local event subscriber registration helpers. - [Function deregister_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-deregister-subscriber.md): Deregister a global lifecycle event subscriber. - [Function flush_subscribers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-flush-subscribers.md): Wait for all subscriber callbacks queued before this call to finish. - [Function register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-register-subscriber.md): Register a global lifecycle event subscriber. - [Function scope_deregister_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-scope-deregister-subscriber.md): Deregister a scope-local lifecycle event subscriber. - [Function scope_register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-scope-register-subscriber.md): Register a scope-local lifecycle event subscriber. - [Module tool](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool.md): Tool lifecycle helpers and managed execution entry points. - [Struct Create Tool Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-createtoolhandleparams.md): Builder parameters for `NemoRelayContextState::create_tool_handle`. - [Struct EndTool Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-endtoolhandleparams.md): Builder parameters for `NemoRelayContextState::build_tool_end_event`. - [Struct Tool Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolattributes.md): Bitflags that modify tool-call behavior and observability. - [Struct Tool Call EndParams](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolcallendparams.md): Builder parameters for `tool_call_end`. - [Struct Tool Call Execute Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolcallexecuteparams.md): Builder parameters for `tool_call_execute`. - [Struct Tool Call Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolcallparams.md): Builder parameters for `tool_call`. - [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept. - [Struct Tool Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolhandle.md): Runtime-owned handle identifying an active or completed tool call. - [Function tool_call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call.md): Start a manual tool lifecycle span. - [Function tool_call_end](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call-end.md): Finish a manual tool lifecycle span. - [Function tool_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call-execute.md): Execute a tool call through the managed middleware pipeline. - [Function tool_conditional_execution](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-conditional-execution.md): Run only the tool conditional-execution guardrail chain. - [Function tool_request_intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-request-intercepts.md): Run only the tool request-intercept chain. - [Module codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec.md): LLM codec types, traits, and built-in implementations. - [Module anthropic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/anthropic.md): Built-in codec for the Anthropic Messages API. - [Struct Anthropic Messages Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/anthropic/struct-anthropicmessagescodec.md): Built-in codec for the Anthropic Messages API. - [Struct Anthropic Messages Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/anthropic/struct-anthropicmessagesstreamingcodec.md): Streaming counterpart to `AnthropicMessagesCodec`. - [Module model_pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing.md): Data-driven LLM model pricing used to layer cost estimates onto usage. - [Enum Cache Read Accounting](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-cachereadaccounting.md): How cache-read tokens relate to prompt token counts in provider usage. - [Struct Model Pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-modelpricing.md): Per-token model pricing expressed in USD per one million tokens. - [Struct Pricing Catalog](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingcatalog.md): Collection of model pricing entries. - [Enum Pricing Catalog Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingcatalogerror.md): Errors produced while parsing or validating a model pricing catalog. - [Struct Pricing Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingconfig.md): Runtime model pricing resolver configuration. - [Struct Pricing Resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingresolver.md): Ordered model pricing lookup chain. - [Struct Token Rate Tier](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenratetier.md): A model pricing tier selected by prompt/input token count. - [Trait Pricing Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/trait-pricingsource.md): Pluggable model pricing source interface. - [Enum Pricing Source Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingsourceconfig.md): Declarative model pricing source supported by Relay configuration. - [Enum Pricing Unit](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingunit.md): Billing unit represented by a model pricing entry. - [Struct Prompt Cache Pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-promptcachepricing.md): Prompt-cache accounting rules for a model pricing entry. - [Struct Token Pricing Rates](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenpricingrates.md): Token rates expressed as USD per one million tokens. - [Enum Rate Schedule Application](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-ratescheduleapplication.md): How a selected rate-schedule tier applies to billable usage. - [Function active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-active-pricing-resolver.md): Returns the active process-wide model pricing resolver. - [Enum Token Rate Schedule](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-tokenrateschedule.md): Data-driven token rate schedule for model pricing with request thresholds. - [Function attach_estimated_cost](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost.md): Adds a model pricing estimate to a normalized response when cost is missing. - [Function attach_estimated_cost_for_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost-for-provider.md): Adds a provider-aware model pricing estimate to a normalized response when cost is missing. - [Function estimate_cost](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost.md): Estimates USD cost for a model/usage pair when model pricing is known. - [Function estimate_cost_for_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-for-provider.md): Estimates USD cost for a provider/model pair when model pricing is known. - [Function estimate_cost_with_catalog](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-catalog.md): Estimates USD cost using the provided catalog. - [Function estimate_cost_with_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-provider.md): Estimates USD cost using the provided catalog and provider/model pair. - [Function infer_model_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-infer-model-provider.md): Infers a provider/route value for a decoded model. - [Function pricing_for_model](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-model.md): Returns known model pricing for a model ID. - [Function pricing_for_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-provider.md): Returns known model pricing for a provider/model pair. - [Function reset_active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-reset-active-pricing-resolver.md): Restores the active process-wide model pricing resolver to an empty resolver. - [Function set_active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-set-active-pricing-resolver.md): Replaces the active process-wide model pricing resolver. - [Module openai_chat](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_chat.md): Built-in codec for the OpenAI Chat Completions API. - [Struct OpenAI Chat Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_chat/struct-openaichatcodec.md): Built-in codec for the OpenAI Chat Completions API. - [Struct OpenAI Chat Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_chat/struct-openaichatstreamingcodec.md): Streaming counterpart to `OpenAIChatCodec`. - [Module openai_responses](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_responses.md): Built-in codec for the OpenAI Responses API. - [Struct OpenAI Responses Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_responses/struct-openairesponsescodec.md): Built-in codec for the OpenAI Responses API. - [Struct OpenAI Responses Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_responses/struct-openairesponsesstreamingcodec.md): Streaming counterpart to `OpenAIResponsesCodec`. - [Module request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request.md): Re-exported normalized LLM request data types. - [Struct Annotated LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-annotatedllmrequest.md): Structured view of an LLM request, produced by a Codec from opaque `LlmRequest` content. - [Struct Function Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-functioncall.md): A function call within a tool call. - [Struct Function Definition](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-functiondefinition.md): A function definition within a tool definition. - [Struct Generation Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-generationparams.md): Normalized generation parameters across providers. - [Struct Open AiImage Url](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-openaiimageurl.md): OpenAI image URL payload. - [Struct Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-toolcall.md): A tool call requested by the assistant. - [Struct Tool Choice Function](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-toolchoicefunction.md): A specific tool choice that forces a named function. - [Struct Tool Choice Function Name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-toolchoicefunctionname.md): The name component of a specific tool choice. - [Struct Tool Definition](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-tooldefinition.md): A tool definition (function schema) available to the model. - [Enum Content Part](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-contentpart.md): A single content part within a multimodal message. - [Enum Message](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-message.md): A single message in a conversation, tagged by role. - [Enum Message Content](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-messagecontent.md): Message content: either a plain string or multimodal parts array. - [Enum Tool Choice](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-toolchoice.md): Tool choice control: how the model should use available tools. - [Module resolve](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve.md): Provider-surface detection and best-effort normalization: the preferred path for turning raw provider JSON into normalized types when no codec annotation is present. - [Enum Provider Surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/enum-providersurface.md): A built-in provider request/response surface. - [Function detect_request_surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-detect-request-surface.md): Detect the request surface from a raw request body by top-level key. - [Function detect_request_surface_with_hint](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-detect-request-surface-with-hint.md): Like `detect_request_surface`, but a recognized `provider_hint` resolves the one ambiguous shape (an Anthropic request without a top-level `system`, otherwise read as OpenAI Chat). Today, only the exact hints `"anthropic"` and `"anthropic.messages"` change detection; `None` or any other value is ignored and detection stays shape-only. - [Function detect_response_surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-detect-response-surface.md): Detect the response surface from a raw provider response, classifying only when exactly one built-in shape matches (the built-in codecs accept minimal objects, so decode success alone is not a reliable classifier). - [Function normalize_request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-normalize-request.md): Best-effort decode of a raw request into `AnnotatedLlmRequest` (fail-open). - [Function normalize_request_with_hint](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-normalize-request-with-hint.md): Like `normalize_request`, but a recognized `provider_hint` can disambiguate provider request shapes that are otherwise identical. - [Function normalize_response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-normalize-response.md): Best-effort decode of a raw response into `AnnotatedLlmResponse` (fail-open). - [Module response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response.md): Re-exported normalized LLM response data types and core pricing helpers. - [Struct Annotated LlmResponse](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-annotatedllmresponse.md): Structured view of an LLM response, produced by a response codec from raw JSON API output. - [Struct Cost Estimate](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-costestimate.md): Normalized LLM response cost. - [Struct Response Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-responsetoolcall.md): A tool call requested by the model in its response. - [Struct Usage](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-usage.md): Token usage statistics from an LLM API response. - [Enum ApiSpecific Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/enum-apispecificresponse.md): API-specific response data that cannot be normalized across providers. - [Enum Cost Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/enum-costsource.md): Source of a normalized cost value. - [Enum Finish Reason](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/enum-finishreason.md): Normalized reason why the model stopped generating. - [Module streaming](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming.md): Streaming response codecs for the managed LLM execution pipeline. - [Struct SseEvent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming/struct-sseevent.md): One decoded SSE frame, paired with the parsed `data:` payload. - [Struct SseEvent Decoder](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming/struct-sseeventdecoder.md): Incremental decoder for `text/event-stream` byte streams that yields one JSON object per complete `data:` payload. - [Trait Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming/trait-streamingcodec.md): Per-provider streaming codec used with `crate::api::llm::llm_stream_call_execute`. - [Module traits](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/traits.md): LLM codec traits for bidirectional request translation. - [Trait LlmCodec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/traits/trait-llmcodec.md): A bidirectional translator between opaque `LlmRequest` content and structured `AnnotatedLlmRequest`. - [Trait LlmResponse Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/traits/trait-llmresponsecodec.md): Decode-only codec for LLM API responses. - [Module config_editor](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor.md): Typed configuration editor metadata. - [Struct Editor Field Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/struct-editorfieldspec.md): Static editor metadata for one configuration field. - [Struct Editor Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/struct-editorschema.md): Static editor metadata for one configuration struct. - [Enum Editor Field Kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/enum-editorfieldkind.md): Editor control shape for one configuration field. - [Trait Editor Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/trait-editorconfig.md): Trait implemented by configuration structs that expose editor metadata. - [Module error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/error.md): Error types for the NeMo Relay runtime. - [Enum Flow Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/error/enum-flowerror.md): The error type for all NeMo Relay runtime operations. - [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/error/type-result.md): A specialized `Result` type for NeMo Relay operations. - [Module json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/json.md): JSON utilities for the NeMo Relay runtime. - [Function merge_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/json/fn-merge-json.md): Shallow-merge two optional JSON values. - [Type Alias Json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/json/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs. - [Module observability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability.md): Optional observability integrations for NeMo Relay Core. - [Module atif](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif.md): Agent Trajectory Interchange Format (ATIF) exporter. - [Struct Atif Agent Info](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifagentinfo.md): Information about the agent that produced the trajectory. - [Struct Atif Ancestry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifancestry.md): Lineage node identifying a callable within an ATIF step. - [Struct Atif Exporter](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifexporter.md): Collects lifecycle events and exports them as ATIF trajectories. - [Struct Atif Final Metrics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atiffinalmetrics.md): Aggregate statistics for the entire trajectory (ATIF final_metrics). - [Struct Atif Invocation Info](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifinvocationinfo.md): Invocation timing and correlation metadata for one execution occurrence. - [Struct Atif Metrics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifmetrics.md): Token usage and cost metrics for a single step. - [Struct Atif Observation](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifobservation.md): Observation results from tool execution. - [Struct Atif Observation Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifobservationresult.md): A single observation result from a tool call. - [Struct Atif Step](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifstep.md): A single step in an ATIF trajectory. - [Struct Atif Step Extra](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifstepextra.md): Lineage payload serialized into ATIF `Step.extra`. - [Struct Atif Subagent Trajectory Ref](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifsubagenttrajectoryref.md): Reference to a delegated subagent trajectory. - [Struct Atif Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atiftoolcall.md): A tool call made by the agent. - [Struct Atif Trajectory](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atiftrajectory.md): A complete ATIF trajectory. - [Constant ATIF_SCHEMA_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/constant-atif-schema-version.md): The ATIF schema version string embedded in all exported trajectories. - [Module atof](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof.md): Agent Trajectory Observability Format (ATOF) JSONL exporter support for NeMo Flow. - [Struct Atof Endpoint Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/struct-atofendpointconfig.md): Streaming destination for raw ATOF events. - [Struct Atof Exporter](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/struct-atofexporter.md): Filesystem-backed Agent Trajectory Observability Format (ATOF) JSONL event exporter. - [Struct Atof Exporter Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/struct-atofexporterconfig.md): Configuration for `AtofExporter`. - [Enum Atof Endpoint Field Name Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofendpointfieldnamepolicy.md): Field name transformation policy used before sending events to an endpoint. - [Enum Atof Endpoint Transport](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofendpointtransport.md): Streaming transport used by an ATOF endpoint. - [Enum Atof Exporter Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofexportererror.md): Errors produced while configuring or operating the ATOF JSONL exporter. - [Enum Atof Exporter Mode](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofexportermode.md): File write behavior for `AtofExporter`. - [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/type-result.md): Result type for the ATOF JSONL exporter. - [Module openinference](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference.md): OpenInference subscriber support for NeMo Relay. - [Struct Open Inference Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/struct-openinferenceconfig.md): Configuration for the OpenInference subscriber. - [Struct Open Inference Subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/struct-openinferencesubscriber.md): OpenInference-backed NeMo Relay subscriber. - [Enum Open Inference Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/enum-openinferenceerror.md): Errors produced while configuring or operating the OpenInference subscriber. - [Enum Otlp Transport](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/enum-otlptransport.md): Supported OTLP trace transports. - [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/type-result.md): Result type for the OpenInference subscriber crate. - [Module otel](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel.md): OpenTelemetry subscriber support for NeMo Relay. - [Struct Open Telemetry Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/struct-opentelemetryconfig.md): Configuration for the OpenTelemetry subscriber. - [Struct Open Telemetry Subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/struct-opentelemetrysubscriber.md): OpenTelemetry-backed NeMo Relay subscriber. - [Enum Open Telemetry Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/enum-opentelemetryerror.md): Errors produced while configuring or operating the OpenTelemetry subscriber. - [Enum Otlp Transport](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/enum-otlptransport.md): Supported OTLP trace transports. - [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/type-result.md): Result type for the OpenTelemetry subscriber crate. - [Module plugin_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component.md): Built-in observability plugin component. - [Struct Atif Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-atifsectionconfig.md): Per-trajectory ATIF exporter config. - [Struct Atof Endpoint Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-atofendpointsectionconfig.md): Streaming destination for raw ATOF events. - [Struct Atof Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-atofsectionconfig.md): Filesystem-backed ATOF JSONL exporter config. - [Struct Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-componentspec.md): Top-level observability component wrapper. - [Struct Http Storage Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-httpstorageconfig.md): HTTP endpoint settings for ATIF trajectory upload. - [Struct Observability Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-observabilityconfig.md): Canonical config document for the observability plugin component. - [Struct Otlp Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-otlpsectionconfig.md): Shared OTLP exporter config for OpenTelemetry and OpenInference. - [Struct S3Storage Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-s3storageconfig.md): S3-compatible storage settings for ATIF trajectory upload. - [Enum Atif Storage Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/enum-atifstorageconfig.md): Remote storage destination for ATIF trajectory files. - [Constant OBSERVABILITY_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/constant-observability-plugin-kind.md): The plugin kind registered by the core crate. - [Function deregister_observability_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/fn-deregister-observability-component.md): Deregisters the observability component kind from the core plugin registry. - [Function register_observability_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/fn-register-observability-component.md): Registers the observability component kind in the core plugin registry. - [Module plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin.md): Generic plugin infrastructure for NeMo Relay runtimes. - [Module dynamic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic.md): Dynamic plugin control-plane and registry model. - [Struct Dynamic Plugin Failure](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginfailure.md): One structured recent failure summary. - [Struct Dynamic Plugin Manifest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifest.md): Authored `relay-plugin.toml` manifest. - [Struct Dynamic Plugin Manifest Capabilities](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestcapabilities.md): Capability declarations for authored manifests. - [Struct Dynamic Plugin Manifest Compat](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestcompat.md): Compatibility block for `relay-plugin.toml`. - [Struct Dynamic Plugin Manifest Config Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestconfigschema.md): Static configuration schema block for authored manifests. - [Struct Dynamic Plugin Manifest Defaults](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestdefaults.md): Defaults block for authored manifests. - [Struct Dynamic Plugin Manifest Integrity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestintegrity.md): Integrity/authenticity evidence block for authored manifests. - [Struct Dynamic Plugin Manifest Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestplugin.md): Plugin identity block for `relay-plugin.toml`. - [Struct Dynamic Plugin Manifest Rust Dynamic Load](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestrustdynamicload.md): Native shared-library authored load block. - [Struct Dynamic Plugin Manifest Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestsource.md): Source block for authored manifests. - [Struct Dynamic Plugin Manifest Worker Load](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestworkerload.md): Worker lane authored load block. - [Struct Dynamic Plugin Metadata](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmetadata.md): Stable metadata for one durable plugin record. - [Struct Dynamic Plugin Record](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginrecord.md): Durable control-plane record for a dynamic plugin. - [Struct Dynamic Plugin Registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginregistry.md): In-memory dynamic plugin registry used by the control plane. - [Struct Dynamic Plugin Runtime Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginruntimestatus.md): Observed runtime state for one plugin record. - [Struct Dynamic Plugin Rust Compatibility](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginrustcompatibility.md): Compatibility contract for native shared libraries. - [Struct Dynamic Plugin Rust Load Contract](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginrustloadcontract.md): Lane-specific load contract for native shared libraries. - [Struct Dynamic Plugin Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginsource.md): Source and resolved artifact facts for a plugin. - [Struct Dynamic Plugin Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginspec.md): Desired-state fields owned by user-facing operations. - [Struct Dynamic Plugin Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginstatus.md): Durable observed state for a plugin record. - [Struct Dynamic Plugin Validation Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginvalidationstatus.md): Decomposed validation results for one plugin record. - [Struct Dynamic Plugin Worker Compatibility](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginworkercompatibility.md): Compatibility contract for worker plugins. - [Struct Dynamic Plugin Worker Load Contract](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginworkerloadcontract.md): Lane-specific load contract for worker plugins. - [Struct Native Plugin Activation](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-nativepluginactivation.md): Owns native dynamic libraries registered into the plugin registry. - [Struct Native Plugin Load Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-nativepluginloadspec.md): Native plugin load request derived from host dynamic-plugin state. - [Enum Dynamic Plugin Attestation Mode](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginattestationmode.md): Host attestation policy mode. - [Enum Dynamic Plugin Capability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicplugincapability.md): Relay-enforced capability declared by a dynamic plugin. - [Enum Dynamic Plugin Check State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicplugincheckstate.md): High-level verification state for one validation axis. - [Enum Dynamic Plugin Compatibility](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicplugincompatibility.md): Lane-specific compatibility declarations and resolved compatibility facts. - [Enum Dynamic Plugin Failure Phase](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginfailurephase.md): Recent failure phase for diagnostics and operator UX. - [Enum Dynamic Plugin Kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginkind.md): Plugin execution lane. - [Enum Dynamic Plugin Load Contract](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginloadcontract.md): Runtime entry contract for the resolved plugin. - [Enum Dynamic Plugin Manifest Load](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginmanifestload.md): Load block for authored manifests. - [Enum Dynamic Plugin Runtime State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginruntimestate.md): Observed runtime state for a dynamic plugin. - [Enum Dynamic Plugin Startup Class](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginstartupclass.md): Host policy startup classification for a plugin. - [Enum Worker Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-workerruntime.md): Managed runtime identity for worker-based plugins. - [Constant DYNAMIC_PLUGIN_MANIFEST_FILENAME](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/constant-dynamic-plugin-manifest-filename.md): Canonical filename for authored Relay plugin manifests. - [Function load_native_plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/fn-load-native-plugins.md): Loads native dynamic plugins and registers their plugin kinds. - [Type Alias Dynamic Plugin Id](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/type-dynamicpluginid.md): Canonical identifier for one dynamic plugin record. - [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-configdiagnostic.md): Structured validation diagnostic for plugin validation. - [Struct Config Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-configpolicy.md): Policy for how unsupported plugin/runtime config is handled. - [Struct Config Report](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-configreport.md): Structured validation report. - [Struct Plugin Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-plugincomponentspec.md): One configured plugin component. - [Struct Plugin Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-pluginconfig.md): Canonical plugin configuration document. - [Struct Plugin Registration](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-pluginregistration.md): Bookkeeping for one middleware/subscriber registration. - [Struct Plugin Registration Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-pluginregistrationcontext.md): Context provided to plugin handlers during runtime registration. - [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/enum-diagnosticlevel.md): Diagnostic severity returned by plugin validation. - [Enum Plugin Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/enum-pluginerror.md): Error type for generic plugin operations. - [Enum Unsupported Behavior](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/enum-unsupportedbehavior.md): Per-policy behavior for unsupported configuration. - [Trait Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/trait-plugin.md): Implemented by custom plugins that register runtime middleware. - [Function active_plugin_report](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-active-plugin-report.md): Returns the last successfully configured plugin report. - [Function clear_plugin_configuration](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-clear-plugin-configuration.md): Deregisters and clears all configured plugin components. - [Function deregister_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-deregister-plugin.md): Removes a previously registered plugin. - [Function ensure_builtin_plugins_registered](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-ensure-builtin-plugins-registered.md): Registers core-provided plugin kinds. - [Function initialize_plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-initialize-plugins.md): Validates and activates `config` layered on top of the discovered `plugins.toml` configuration, so a direct integration sees the same file layering as the gateway. `config` wins on conflicts; as a typed document its default `version`/`policy`/`enabled` override the file, while `config` bodies merge field-by-field. Delegates to `initialize_plugins_exact`. - [Function list_plugin_kinds](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-list-plugin-kinds.md): Lists registered plugin kinds in sorted order. - [Function lookup_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-lookup-plugin.md): Looks up a registered plugin by kind. - [Function register_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-register-plugin.md): Registers a plugin by kind. - [Function rollback_registrations](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-rollback-registrations.md): Rolls back registrations in reverse order, ignoring rollback failures. - [Function validate_plugin_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-validate-plugin-config.md): Validates a plugin configuration document. - [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/type-result.md): Specialized `Result` type for plugin operations. - [Module plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins.md): First-party plugin implementations for NeMo Relay Core. - [Module model_pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/model_pricing.md): Built-in model pricing plugin component module. - [Constant PRICING_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/model_pricing/constant-pricing-plugin-kind.md): Plugin kind used by the model pricing component. - [Function register_pricing_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/model_pricing/fn-register-pricing-component.md): Registers the built-in model pricing component. - [Module nemo_guardrails](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails.md): Planned NeMo Guardrails plugin integrations for NeMo Relay Core. - [Module component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component.md): NeMo Guardrails plugin component contract. - [Struct Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-componentspec.md): Top-level NeMo Guardrails component wrapper. - [Struct Local Backend Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-localbackendconfig.md): Local-backend settings for the Python `nemoguardrails` runtime. - [Struct NeMo Guardrails Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-nemoguardrailsconfig.md): Canonical config document for the planned NeMo Guardrails component. - [Struct Remote Backend Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-remotebackendconfig.md): Remote-backend settings for a hosted NeMo Guardrails service. - [Struct Request Defaults Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-requestdefaultsconfig.md): Default request semantics applied by the selected Guardrails backend. - [Struct Request Rails Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-requestrailsconfig.md): Request-time rail selection for Guardrails generation. - [Enum Rail Selector](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/enum-railselector.md): Rail-selection shape used by Guardrails generation options. - [Constant NEMO_GUARDRAILS_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/constant-nemo-guardrails-plugin-kind.md): The plugin kind reserved for the planned first-party component. - [Function deregister_nemo_guardrails_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/fn-deregister-nemo-guardrails-component.md): Deregisters the `nemo_guardrails` component kind from the plugin registry. - [Function register_nemo_guardrails_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/fn-register-nemo-guardrails-component.md): Registers the `nemo_guardrails` component kind in the plugin registry. - [Module stream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/stream.md): Streaming LLM response wrapper. - [Struct LlmStream Wrapper](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/stream/struct-llmstreamwrapper.md): Wraps an inner `Stream>` of raw chunks and: - [Macro editor_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/macro-editor-config.md): Implements `EditorConfig` for a configuration type.