> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# nemo-relay-runtime

> Runtime execution, registries, scopes, and continuation handling for NeMo Relay. Component implementations are supplied by the embedding SDK or application.

Generated from `cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

Runtime execution, registries, scopes, and continuation handling for NeMo Relay. Component implementations are supplied by the embedding SDK or application.

## Modules

* [api](/reference/api/rust-library-reference/nemo-relay-runtime/api): Public API for the NeMo Relay runtime.
* [codec](/reference/api/rust-library-reference/nemo-relay-runtime/codec): Runtime normalization composes provider codecs with the configured pricing service.
* [composition](/reference/api/rust-library-reference/nemo-relay-runtime/composition): Services supplied by the SDK or an embedding application. Component services supplied by plugin-host or an embedding application.
* [config_editor](/reference/api/rust-library-reference/nemo-relay-runtime/config_editor): Shared configuration editor metadata.
* [error](/reference/api/rust-library-reference/nemo-relay-runtime/error): Shared runtime errors, preserved at the core import path.
* [json](/reference/api/rust-library-reference/nemo-relay-runtime/json): JSON utilities for the NeMo Relay runtime.
* [pricing](/reference/api/rust-library-reference/nemo-relay-runtime/pricing): Runtime pricing service adapters. Host-supplied model pricing without a dependency on a pricing implementation.
* [registry](/reference/api/rust-library-reference/nemo-relay-runtime/registry): Priority-sorted named registry.
* [stream](/reference/api/rust-library-reference/nemo-relay-runtime/stream): Streaming LLM response wrapper.

## Macros

* [editor_config](/reference/api/rust-library-reference/nemo-relay-runtime/macro-editor-config): Declare typed configuration editor metadata. Implements [`EditorConfig`](/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/trait-editorconfig) for a configuration type.

> Runtime execution, registries, scopes, and continuation handling for NeMo Relay. Component implementations are supplied by the embedding SDK or application.

## Docs

- [Module api](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api.md): Public API for the NeMo Relay runtime.
- [Module event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event.md): Lifecycle event types and builder-backed event constructors. Event types for Agent Trajectory Observability Format (ATOF) runtime events.
- [Struct Base Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-baseevent.md): Shared event metadata carried by every ATOF event.
- [Struct Category Profile](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-categoryprofile.md): Category-specific profile data.
- [Struct Data Schema](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-dataschema.md): Identifier for the schema that describes an event's opaque `data` payload.
- [Struct Event Category](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-eventcategory.md): Semantic category carried by ATOF `category`.
- [Struct Event Sanitize Fields](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-eventsanitizefields.md): Observability fields that event sanitizers may rewrite.
- [Struct Finite F64](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-finitef64.md): A finite IEEE 754 double-precision value.
- [Struct Histogram Boundaries](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-histogramboundaries.md): Explicit histogram bucket boundaries that are finite and strictly increasing.
- [Struct Instrument Descriptor](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-instrumentdescriptor.md): Descriptor fields shared by all recordings of an instrument.
- [Struct Instrument Name](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-instrumentname.md): An OpenTelemetry instrument name together with its canonical form.
- [Struct Mark Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-markevent.md): ATOF point-in-time mark event.
- [Struct Metric Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-metricattributes.md): A deterministic map of typed OpenTelemetry metric attributes.
- [Struct Metric Envelope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-metricenvelope.md): Payload stored in a mark using `METRIC_DATA_SCHEMA_NAME`.
- [Struct Metric Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-metricmeasurement.md): One recording operation in a Relay metric mark.
- [Struct Metric Validation Error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-metricvalidationerror.md): Validation error for a Relay metric envelope.
- [Struct Parse LogSeverity Error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-parselogseverityerror.md): Error returned when parsing an unsupported log severity.
- [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner.
- [Struct Scope Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-scopeevent.md): ATOF scope lifecycle event.
- [Struct Validated Metric Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/struct-validatedmetricmeasurement.md): Parsed metric measurement that is safe for OTLP export.
- [Enum Attribute Value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-attributevalue.md): Typed OpenTelemetry attribute values, including homogeneous primitive arrays.
- [Enum Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime.
- [Enum LogSeverity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-logseverity.md): Severity attached to a mark that may be projected as an OpenTelemetry log.
- [Enum Metric Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-metrickind.md): OpenTelemetry instrument kind represented by a metric measurement mark.
- [Enum Metric Value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-metricvalue.md): One typed metric value accepted by Relay's metric schema.
- [Enum Metric Value Type](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-metricvaluetype.md): Numeric representation used by a metric measurement.
- [Enum Scope Category](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/enum-scopecategory.md): Agent Trajectory Observability Format (ATOF) lifecycle phase for a scope event.
- [Constant ATOF_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/constant-atof-version.md): Agent Trajectory Observability Format (ATOF) protocol version emitted by this runtime.
- [Constant LOG_SEVERITY_METADATA_KEY](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/constant-log-severity-metadata-key.md): Reserved metadata key carrying the canonical severity of a mark exported as a log.
- [Constant METRIC_DATA_SCHEMA_NAME](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/constant-metric-data-schema-name.md): Relay-owned schema name for mark payloads containing metric measurements.
- [Constant METRIC_DATA_SCHEMA_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/constant-metric-data-schema-version.md): Current Relay-owned metric measurement schema version.
- [Trait Event Normalization Ext](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/trait-eventnormalizationext.md): Core-only normalized LLM accessors for ATOF events.
- [Function attributes_from_handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/fn-attributes-from-handle.md): Convert handle bitflags into ATOF attributes.
- [Function llm_attributes_to_strings](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/fn-llm-attributes-to-strings.md): Convert LLM bitflags into ATOF attributes.
- [Function scope_attributes_to_strings](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/fn-scope-attributes-to-strings.md): Convert scope bitflags into ATOF attributes.
- [Function tool_attributes_to_strings](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/fn-tool-attributes-to-strings.md): Convert tool bitflags into ATOF attributes.
- [Function validate_metric_measurements](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/event/fn-validate-metric-measurements.md): Validate a complete list of metric measurements atomically.
- [Module llm](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm.md): LLM lifecycle helpers and managed execution entry points.
- [Struct Create LlmHandle Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-createllmhandleparams.md): Builder parameters for `NemoRelayContextState::create_llm_handle`.
- [Struct EndLlm Handle Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-endllmhandleparams.md): Builder parameters for `NemoRelayContextState::build_llm_end_event`.
- [Struct LlmAttributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmattributes.md): Bitflags that modify LLM-call behavior and observability.
- [Struct LlmCall EndParams](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmcallendparams.md): Builder parameters for `llm_call_end`.
- [Struct LlmCall Execute Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmcallexecuteparams.md): Builder parameters for `llm_call_execute`.
- [Struct LlmCall Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmcallparams.md): Builder parameters for `llm_call`.
- [Struct LlmHandle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmhandle.md): Runtime-owned handle identifying an active or completed LLM call.
- [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime.
- [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks.
- [Struct LlmStream Call Execute Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/struct-llmstreamcallexecuteparams.md): Builder parameters for `llm_stream_call_execute`.
- [Constant LLM_REQUEST_INTERCEPT_OUTCOME_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/constant-llm-request-intercept-outcome-schema.md): Versioned JSON envelope schema for `LlmRequestInterceptOutcome`.
- [Function llm_call](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/fn-llm-call.md): Start a manual LLM lifecycle span.
- [Function llm_call_end](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/fn-llm-call-end.md): Finish a manual LLM lifecycle span.
- [Function llm_call_execute](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/fn-llm-call-execute.md): Execute an LLM call through the managed middleware pipeline.
- [Function llm_conditional_execution](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/fn-llm-conditional-execution.md): Run only the LLM conditional-execution guardrail chain.
- [Function llm_request_intercepts](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/fn-llm-request-intercepts.md): Run only the LLM request-intercept chain.
- [Function llm_stream_call_execute](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/llm/fn-llm-stream-call-execute.md): Execute a streaming LLM call through the managed middleware pipeline.
- [Module optimization](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization.md): Plugin-neutral evidence recording for managed LLM calls. Managed, bounded LLM optimization accounting.
- [Struct LlmOptimization Recorder](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/struct-llmoptimizationrecorder.md): Cloneable capability for adding evidence to the current managed LLM call.
- [Constant MAX_LLM_OPTIMIZATION_CONTRIBUTIONS](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/constant-max-llm-optimization-contributions.md): Maximum contributions retained for one LLM call.
- [Constant MAX_LLM_OPTIMIZATION_CONTRIBUTION_ATTEMPTS](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/constant-max-llm-optimization-contribution-attempts.md): Maximum contribution records inspected before the recorder seals itself.
- [Constant MAX_LLM_OPTIMIZATION_CONTRIBUTION_BYTES](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/constant-max-llm-optimization-contribution-bytes.md): Maximum serialized size of one complete contribution envelope.
- [Constant MAX_LLM_OPTIMIZATION_TOTAL_CONTRIBUTION_BYTES](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/constant-max-llm-optimization-total-contribution-bytes.md): Maximum aggregate serialized size of all contribution envelopes for one call.
- [Function current_llm_optimization_recorder](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/fn-current-llm-optimization-recorder.md): Return a recorder for the current execution intercept, if it is managed by Relay.
- [Function record_llm_optimization_contribution](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/fn-record-llm-optimization-contribution.md): Best-effort shorthand for recording evidence on the current managed call.
- [Function scope_llm_optimization_recorder](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/optimization/fn-scope-llm-optimization-recorder.md): Install an optimization recorder for the duration of an asynchronous operation.
- [Module registry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry.md): Global and scope-local middleware registration helpers. Middleware registry helpers for global and scope-local guardrails, intercepts, and subscribers.
- [Struct Registry Record](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/struct-registryrecord.md): A priority-ordered registration record.
- [Struct Runtime Registration Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/struct-runtimeregistrationidentity.md): Structured identity for a global gateable runtime registration.
- [Struct Runtime Registration Owner](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/struct-runtimeregistrationowner.md): Discovery metadata describing the owner of a runtime registration.
- [Enum Runtime Registration Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/enum-runtimeregistrationkind.md): A global runtime registration surface that can be selected by a conditional middleware guardrail.
- [Enum Runtime Registration Owner Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/enum-runtimeregistrationownerkind.md): The owner category reported for a global runtime registration.
- [Function deregister_conditional_middleware_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-conditional-middleware-guardrail.md): Deregister a global conditional middleware guardrail.
- [Function deregister_event_metadata_injector](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-event-metadata-injector.md): Deregister a global Event metadata injector.
- [Function deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-llm-conditional-execution-guardrail.md): Deregister a global LLM conditional-execution guardrail.
- [Function deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-llm-execution-intercept.md): Deregister a global LLM execution intercept.
- [Function deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-llm-request-intercept.md): Deregister a global LLM request intercept.
- [Function deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-llm-sanitize-request-guardrail.md): Deregister a global LLM sanitize-request guardrail.
- [Function deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-llm-sanitize-response-guardrail.md): Deregister a global LLM sanitize-response guardrail.
- [Function deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-llm-stream-execution-intercept.md): Deregister a global streaming LLM execution intercept.
- [Function deregister_mark_sanitize_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-mark-sanitize-guardrail.md): Deregister a global mark event sanitizer.
- [Function deregister_scope_sanitize_end_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-scope-sanitize-end-guardrail.md): Deregister a global scope-end event sanitizer.
- [Function deregister_scope_sanitize_start_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-scope-sanitize-start-guardrail.md): Deregister a global scope-start event sanitizer.
- [Function deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-tool-conditional-execution-guardrail.md): Deregister a global tool conditional-execution guardrail.
- [Function deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-tool-execution-intercept.md): Deregister a global tool execution intercept.
- [Function deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-tool-request-intercept.md): Deregister a global tool request intercept.
- [Function deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-tool-sanitize-request-guardrail.md): Deregister a global tool sanitize-request guardrail.
- [Function deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-deregister-tool-sanitize-response-guardrail.md): Deregister a global tool sanitize-response guardrail.
- [Function list_runtime_registrations](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-list-runtime-registrations.md): List a deterministic snapshot of global gateable runtime registrations.
- [Function register_conditional_middleware_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-conditional-middleware-guardrail.md): Register a global conditional middleware guardrail.
- [Function register_event_metadata_injector](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-event-metadata-injector.md): Register a global Event metadata injector.
- [Function register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-llm-conditional-execution-guardrail.md): Register a global LLM conditional-execution guardrail. The guardrail can block LLM execution before intercepts or the provider callback run.
- [Function register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-llm-execution-intercept.md): Register a global LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback.
- [Function register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-llm-request-intercept.md): Register a global LLM request intercept. Request intercepts can rewrite or annotate the outgoing LLM request and schedule lifecycle marks for the resulting LLM scope.
- [Function register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-llm-sanitize-request-guardrail.md): Register a global LLM sanitize-request guardrail. The guardrail rewrites only the request payload recorded on emitted start events.
- [Function register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-llm-sanitize-response-guardrail.md): Register a global LLM sanitize-response guardrail. The guardrail rewrites only the response payload recorded on emitted end events.
- [Function register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-llm-stream-execution-intercept.md): Register a global streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback.
- [Function register_mark_sanitize_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-mark-sanitize-guardrail.md): Register a global mark event sanitizer.
- [Function register_scope_sanitize_end_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-scope-sanitize-end-guardrail.md): Register a global scope-end event sanitizer.
- [Function register_scope_sanitize_start_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-scope-sanitize-start-guardrail.md): Register a global scope-start event sanitizer.
- [Function register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-tool-conditional-execution-guardrail.md): Register a global tool conditional-execution guardrail. The guardrail can block tool execution before intercepts or the tool callback run.
- [Function register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-tool-execution-intercept.md): Register a global tool execution intercept that receives the full `ToolExecutionContext`, including the managed `tool_call_id`. Execution intercepts can wrap or replace the tool callback. Each callback returns a canonical tool execution outcome, while its continuation resolves to the downstream `ToolExecutionResult`.
- [Function register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-tool-request-intercept.md): Register a global tool request intercept. Request intercepts can rewrite tool arguments before execution.
- [Function register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-tool-sanitize-request-guardrail.md): Register a global tool sanitize-request guardrail. The guardrail rewrites only the tool input recorded on emitted start events.
- [Function register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-register-tool-sanitize-response-guardrail.md): Register a global tool sanitize-response guardrail. The guardrail rewrites only the tool output recorded on emitted end events.
- [Function runtime_registration_is_enabled](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-runtime-registration-is-enabled.md): Return whether one global runtime registration is enabled by every matching conditional middleware guardrail.
- [Function scope_deregister_event_metadata_injector](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-event-metadata-injector.md): Deregister an Event metadata injector owned by an active scope.
- [Function scope_deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-llm-conditional-execution-guardrail.md): Deregister a scope-local LLM conditional-execution guardrail.
- [Function scope_deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-llm-execution-intercept.md): Deregister a scope-local LLM execution intercept.
- [Function scope_deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-llm-request-intercept.md): Deregister a scope-local LLM request intercept.
- [Function scope_deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-llm-sanitize-request-guardrail.md): Deregister a scope-local LLM sanitize-request guardrail.
- [Function scope_deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-llm-sanitize-response-guardrail.md): Deregister a scope-local LLM sanitize-response guardrail.
- [Function scope_deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-llm-stream-execution-intercept.md): Deregister a scope-local streaming LLM execution intercept.
- [Function scope_deregister_mark_sanitize_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-mark-sanitize-guardrail.md): Deregister a scope-local mark event sanitizer.
- [Function scope_deregister_scope_sanitize_end_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-scope-sanitize-end-guardrail.md): Deregister a scope-local scope-end event sanitizer.
- [Function scope_deregister_scope_sanitize_start_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-scope-sanitize-start-guardrail.md): Deregister a scope-local scope-start event sanitizer.
- [Function scope_deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-tool-conditional-execution-guardrail.md): Deregister a scope-local tool conditional-execution guardrail.
- [Function scope_deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-tool-execution-intercept.md): Deregister a scope-local tool execution intercept.
- [Function scope_deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-tool-request-intercept.md): Deregister a scope-local tool request intercept.
- [Function scope_deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-tool-sanitize-request-guardrail.md): Deregister a scope-local tool sanitize-request guardrail.
- [Function scope_deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-deregister-tool-sanitize-response-guardrail.md): Deregister a scope-local tool sanitize-response guardrail.
- [Function scope_register_event_metadata_injector](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-event-metadata-injector.md): Register an Event metadata injector owned by an active scope.
- [Function scope_register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-llm-conditional-execution-guardrail.md): Register a scope-local LLM conditional-execution guardrail. The guardrail can block LLM execution inside the owning scope.
- [Function scope_register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-llm-execution-intercept.md): Register a scope-local LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback inside the owning scope.
- [Function scope_register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-llm-request-intercept.md): Register a scope-local LLM request intercept. Request intercepts can rewrite or annotate LLM requests inside the owning scope and schedule lifecycle marks for the resulting LLM scope.
- [Function scope_register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-llm-sanitize-request-guardrail.md): Register a scope-local LLM sanitize-request guardrail. The guardrail rewrites only request payloads emitted under the owning scope.
- [Function scope_register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-llm-sanitize-response-guardrail.md): Register a scope-local LLM sanitize-response guardrail. The guardrail rewrites only response payloads emitted under the owning scope.
- [Function scope_register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-llm-stream-execution-intercept.md): Register a scope-local streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback inside the owning scope.
- [Function scope_register_mark_sanitize_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-mark-sanitize-guardrail.md): Register a scope-local mark event sanitizer.
- [Function scope_register_scope_sanitize_end_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-scope-sanitize-end-guardrail.md): Register a scope-local scope-end event sanitizer.
- [Function scope_register_scope_sanitize_start_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-scope-sanitize-start-guardrail.md): Register a scope-local scope-start event sanitizer.
- [Function scope_register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-tool-conditional-execution-guardrail.md): Register a scope-local tool conditional-execution guardrail. The guardrail can block tool execution inside the owning scope.
- [Function scope_register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-tool-execution-intercept.md): Register a scope-local tool execution intercept that receives the full `ToolExecutionContext`, including the managed `tool_call_id`. Execution intercepts can wrap or replace the tool callback inside the owning scope. Each callback returns a canonical tool execution outcome, while its continuation resolves to the downstream `ToolExecutionResult`.
- [Function scope_register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-tool-request-intercept.md): Register a scope-local tool request intercept. Request intercepts can rewrite tool arguments inside the owning scope.
- [Function scope_register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-tool-sanitize-request-guardrail.md): Register a scope-local tool sanitize-request guardrail. The guardrail rewrites only tool input emitted under the owning scope.
- [Function scope_register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/registry/fn-scope-register-tool-sanitize-response-guardrail.md): Register a scope-local tool sanitize-response guardrail. The guardrail rewrites only tool output emitted under the owning scope.
- [Module resource_metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics.md): System resource metric acquisition and polling APIs. Fresh and managed system resource metric observation.
- [Struct Accelerator Device Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-acceleratordevicemetrics.md): Device-wide accelerator measurements.
- [Struct Accelerator Process Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-acceleratorprocessmetrics.md): Accelerator measurements attributed to one process in the selected scope.
- [Struct CpuMetrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-cpumetrics.md): CPU measurements and CPU limit events.
- [Struct Disk Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-diskmetrics.md): Disk I/O for the measured process scope and filesystem capacity.
- [Struct Filesystem Capacity Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-filesystemcapacitymetrics.md): Filesystem capacity for one configured path.
- [Struct GpuMetrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-gpumetrics.md): Accelerator (GPU) device-wide and process-attributed measurements.
- [Struct Memory Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-memorymetrics.md): Memory measurements and memory limit events.
- [Struct Network Interface Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-networkinterfacemetrics.md): Network traffic for one visible interface.
- [Struct Network Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-networkmetrics.md): System-wide network traffic, regardless of the process measurement scope.
- [Struct Network Traffic Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-networktrafficmetrics.md): Network counters for one interface or the selected system aggregate.
- [Struct Process Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-processmetrics.md): Process counts, process limits, handles, and descriptors.
- [Struct Process Sampling Metadata](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-processsamplingmetadata.md): Coverage of process queries used for process-summed measurements.
- [Struct Resource Limit Event Count](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-resourcelimiteventcount.md): One typed cumulative resource-limit event counter.
- [Struct Resource Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-resourcemeasurement.md): One available resource measurement.
- [Struct Resource Metrics Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/struct-resourcemetricssnapshot.md): One point-in-time observation of the selected system and process resources.
- [Enum Accelerator Vendor](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-acceleratorvendor.md): Accelerator vendor associated with a metric record.
- [Enum Bandwidth Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-bandwidthunit.md): Units for data transferred per second.
- [Enum Capacity Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-capacityunit.md): Units for memory and filesystem capacity.
- [Enum Count Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-countunit.md): Fixed units for process, resource, and operation counts.
- [Enum CpuUnit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-cpuunit.md): Units for CPU consumption and effective capacity.
- [Enum Data Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-dataunit.md): Units for cumulative transferred data.
- [Enum Duration Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-durationunit.md): Units for elapsed and cumulative durations.
- [Enum Resource Limit Event Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-resourcelimiteventkind.md): Direct operating-system resource-limit event kind.
- [Enum Resource Limit Resource](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-resourcelimitresource.md): Resource whose configured boundary produced a limit event.
- [Enum Resource Measurement Scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-resourcemeasurementscope.md): System or process boundary measured by a snapshot.
- [Enum Resource Metric Value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-resourcemetricvalue.md): Exact integral values remain integers; converted fractional values are decimals.
- [Enum Resource Operating System](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-resourceoperatingsystem.md): Operating system that produced a resource metrics snapshot.
- [Enum Utilization Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/enum-utilizationunit.md): Units for GPU compute utilization.
- [Constant RESOURCE_METRICS_EVENT_NAME](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/constant-resource-metrics-event-name.md): Canonical event name for resource metric marks.
- [Trait Resource Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/resource_metrics/trait-resourceunit.md): A unit with a stable name in snapshots and metric marks.
- [Module runtime](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime.md): Advanced runtime state, callbacks, and scope-stack helpers. Advanced runtime state, callbacks, and scope-stack helpers.
- [Module callbacks](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks.md): Shared middleware callback contracts and core registry aliases.
- [Struct LlmJson Stream](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/struct-llmjsonstream.md): Stream of JSON chunks produced by the managed streaming LLM pipeline.
- [Struct LlmSanitize Request Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/struct-llmsanitizerequestcontext.md): Per-call codec identity and capability for an LLM request.
- [Struct LlmSanitize Response Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/struct-llmsanitizeresponsecontext.md): Per-call codec identity and capability for an LLM response.
- [Struct Tool Execution Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/struct-toolexecutioncontext.md): Per-call context delivered to a tool execution intercept.
- [Enum Builtin LlmCodec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/enum-builtinllmcodec.md): Relay's built-in LLM codec identities.
- [Enum LlmCodec Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/enum-llmcodecidentity.md): Per-call LLM codec identity supplied to sanitizer and SDK callbacks.
- [Enum LlmCollector](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/enum-llmcollector.md): Collector used to accumulate streaming response chunks.
- [Enum LlmFinalizer](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/enum-llmfinalizer.md): Finalizer used to synthesize the aggregate streaming response payload.
- [Trait LlmStream Inner](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/trait-llmstreaminner.md): Internal close-aware stream implementation.
- [Type Alias Conditional Middleware Guardrail Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-conditionalmiddlewareguardrailfn.md): Decide whether matching global runtime registrations remain eligible.
- [Type Alias Event Metadata Injector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-eventmetadatainjectorfn.md): Add flat metadata attributes to a fully constructed event.
- [Type Alias Event Sanitize Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-eventsanitizefn.md): Sanitize mutable observability fields on a fully constructed event.
- [Type Alias Event Subscriber Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-eventsubscriberfn.md): Consume runtime lifecycle events after they are emitted.
- [Type Alias LlmAsync Collector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmasynccollectorfn.md): Collector that is awaited; see `LlmCollector`.
- [Type Alias LlmAsync Finalizer Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmasyncfinalizerfn.md): Finalizer that is awaited; see `LlmFinalizer`.
- [Type Alias LlmBorrowed Collector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmborrowedcollectorfn.md): Collector that reads each provider JSON chunk without copying it.
- [Type Alias LlmCollector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmcollectorfn.md): Per-chunk collector used by the streaming LLM runtime.
- [Type Alias LlmCollector Future](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmcollectorfuture.md): Future returned by an asynchronous collector.
- [Type Alias LlmConditional Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmconditionalfn.md): Decide whether an LLM call is allowed to continue.
- [Type Alias LlmExecution Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmexecutionfn.md): Wrap or replace non-streaming LLM execution.
- [Type Alias LlmExecution Next Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmexecutionnextfn.md): Continuation type invoked by non-streaming LLM execution intercepts.
- [Type Alias LlmFallible Finalizer Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmfalliblefinalizerfn.md): Finalizer that can fail; see `LlmFinalizer`.
- [Type Alias LlmFinalizer Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmfinalizerfn.md): Finalizer used to synthesize the aggregate streaming response payload.
- [Type Alias LlmFinalizer Future](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmfinalizerfuture.md): Future returned by an asynchronous finalizer.
- [Type Alias LlmRequest Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmrequestcontext.md): Request codec context exposed to an LLM execution intercept.
- [Type Alias LlmRequest Intercept Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmrequestinterceptfn.md): Rewrite or annotate an LLM request before execution.
- [Type Alias LlmResponse Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmresponsecontext.md): Response codec context exposed to a non-streaming LLM execution intercept.
- [Type Alias LlmSanitize Request Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmsanitizerequestfn.md): Sanitize an LLM request before the runtime records it.
- [Type Alias LlmSanitize Response Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmsanitizeresponsefn.md): Sanitize an LLM response before the runtime records it.
- [Type Alias LlmStream Execution Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmstreamexecutionfn.md): Wrap or replace streaming LLM execution.
- [Type Alias LlmStream Execution Next Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-llmstreamexecutionnextfn.md): Continuation type invoked by streaming LLM execution intercepts.
- [Type Alias Tool Conditional Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-toolconditionalfn.md): Decide whether a tool call is allowed to continue.
- [Type Alias Tool Execution Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-toolexecutionfn.md): Wrap or replace tool execution with access to the full call context.
- [Type Alias Tool Execution Next Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-toolexecutionnextfn.md): Continuation type invoked by tool execution intercepts.
- [Type Alias Tool Intercept Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-toolinterceptfn.md): Rewrite tool arguments before execution.
- [Type Alias Tool Sanitize Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/callbacks/type-toolsanitizefn.md): Sanitize a tool request payload before the runtime records it.
- [Module global](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/global.md): Process-global access to the shared runtime context state.
- [Function global_context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/global/fn-global-context.md): Return the process-global runtime context state handle.
- [Module scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack.md): Scope stack storage and propagation helpers.
- [Struct Propagation Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/struct-propagationcontext.md): Versioned, transport-neutral causal context for crossing a Relay boundary.
- [Struct Scope Stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/struct-scopestack.md): Mutable stack of active scopes plus their scope-local registries.
- [Struct Scope Stack Entry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/struct-scopestackentry.md): Identity of one entry in the visible Relay scope stack.
- [Struct Scope Stack Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/struct-scopestacksnapshot.md): Owned root-to-top values from one coherent read of a visible scope stack.
- [Struct Thread Scope Stack Binding](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/struct-threadscopestackbinding.md): Captured thread-local scope stack binding.
- [Struct W3cTrace Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/struct-w3ctracecontext.md): Validated W3C Trace Context retained internally across local stack forks.
- [Static TASK_SCOPE_STACK](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/static-task-scope-stack.md): Task-local scope stack handle used by async execution contexts.
- [Function active_event_trace_context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-active-event-trace-context.md): Return trace propagation context for the current active event.
- [Function active_event_uuid](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-active-event-uuid.md): Return the current active lifecycle event identity.
- [Function capture_propagation_context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-capture-propagation-context.md): Capture the current causal parent and its Relay root when available.
- [Function capture_propagation_context_with_root](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-capture-propagation-context-with-root.md): Capture the current causal parent and an application-supplied session root. Without an imported W3C parent, the supplied root determines the receiver's trace. An imported W3C parent retains precedence over the Relay root. Passing `None` has the same behavior as `capture_rootless_propagation_context`.
- [Function capture_rootless_propagation_context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-capture-rootless-propagation-context.md): Capture the current causal parent without a root UUID.
- [Function capture_thread_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-capture-thread-scope-stack.md): Capture the current thread-local scope stack binding.
- [Function capture_traceparent](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-capture-traceparent.md): Capture the current canonical W3C `traceparent` value.
- [Function create_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-create-scope-stack.md): Create a new scope stack handle with an implicit root scope.
- [Function create_scope_stack_from_propagation](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-create-scope-stack-from-propagation.md): Create an isolated scope stack rooted below a supplied propagation context.
- [Function current_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-current-scope-stack.md): Return the scope stack visible to the current execution context.
- [Function current_scope_stack_override](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-current-scope-stack-override.md): Return the scope stack override installed on the current thread.
- [Function current_scope_stack_snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-current-scope-stack-snapshot.md): Return detached identities from the calling context's explicitly active stack.
- [Function explicit_thread_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-explicit-thread-scope-stack.md): Return the explicitly installed thread-local scope stack.
- [Function fork_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-fork-scope-stack.md): Create an isolated scope stack below the current causal parent.
- [Function install_scope_stack_override](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-install-scope-stack-override.md): Install `handle` as the scope stack override and return the previous one.
- [Function propagate_scope_to_thread](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-propagate-scope-to-thread.md): Capture the current scope stack handle for use in another thread.
- [Function restore_scope_stack_override](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-restore-scope-stack-override.md): Restore an override returned by `install_scope_stack_override`.
- [Function restore_thread_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-restore-thread-scope-stack.md): Restore a previously captured thread-local scope stack binding.
- [Function scope_stack_active](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-scope-stack-active.md): Report whether the current context has an explicitly active scope stack.
- [Function set_thread_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-set-thread-scope-stack.md): Install an explicit scope stack for the current thread.
- [Function sync_thread_active_event_for_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-sync-thread-active-event-for-stack.md): Synchronize the task-local managed event onto an isolated thread stack.
- [Function sync_thread_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-sync-thread-scope-stack.md): Synchronize the thread-local scope stack without marking it explicit.
- [Function task_scope_push](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-task-scope-push.md): Push a scope handle onto the active stack.
- [Function task_scope_remove](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-task-scope-remove.md): Remove a scope handle from the active stack.
- [Function task_scope_top](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-task-scope-top.md): Clone the current top-most scope handle from the active stack.
- [Function with_active_event_trace_context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-with-active-event-trace-context.md): Bind trace context to an active event while polling an operation.
- [Function with_active_event_uuid](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-with-active-event-uuid.md): Run a future with `uuid` as the causally active managed event.
- [Function with_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-with-scope-stack.md): Run a synchronous callback with `handle` as the visible scope stack.
- [Function with_task_scope_stack](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/fn-with-task-scope-stack.md): Run a future with an explicit, task-local scope stack.
- [Type Alias Scope Stack Handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/scope_stack/type-scopestackhandle.md): Shared handle type for the runtime scope stack.
- [Module state](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/state.md): Process-global runtime state and middleware-chain builders.
- [Struct Nemo Relay Context State](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/state/struct-nemorelaycontextstate.md): Process-global runtime state backing middleware and event emission.
- [Module subscriber_dispatcher](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher.md): Asynchronous subscriber delivery for native targets.
- [Struct Async Publication](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/struct-asyncpublication.md): A dispatcher reservation retained by an asynchronous operation.
- [Function dispatch_sanitized_event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/fn-dispatch-sanitized-event.md): Queue a snapshot for serial event sanitization followed by subscriber delivery. Used by synchronous scope and mark APIs.
- [Function flush_queued_subscribers](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/fn-flush-queued-subscribers.md): Wait only for subscriber publications already queued on the dispatcher.
- [Function flush_subscribers](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/fn-flush-subscribers.md): Wait for all queued subscriber callbacks and managed terminal publications registered before this call, including publications emitted transitively by those callbacks.
- [Function register_async_publication](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/fn-register-async-publication.md): Register a FIFO barrier for async work that will queue a subscriber event.
- [Function with_async_publication_context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/fn-with-async-publication-context.md): Run asynchronous middleware as part of an already-registered publication, buffering the finalization publications explicitly assigned to its reserved FIFO position.
- [Type Alias Publication Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/subscriber_dispatcher/type-publicationcontext.md): Binding-owned context captured when an event is emitted.
- [Struct LlmExecution Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-llmexecutioncontext.md): Codec access for one LLM execution.
- [Struct LlmJson Stream](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-llmjsonstream.md): Stream of JSON chunks produced by the managed streaming LLM pipeline.
- [Struct LlmSanitize Request Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-llmsanitizerequestcontext.md): Per-call codec identity and capability for an LLM request.
- [Struct LlmSanitize Response Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-llmsanitizeresponsecontext.md): Per-call codec identity and capability for an LLM response.
- [Struct Middleware Continuation Lease](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-middlewarecontinuationlease.md): A continuation that remains valid while its owning interceptor is running.
- [Struct Scope Stack Entry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-scopestackentry.md): Identity of one entry in the visible Relay scope stack.
- [Struct Scope Stack Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-scopestacksnapshot.md): Owned root-to-top values from one coherent read of a visible scope stack.
- [Struct Tool Execution Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/struct-toolexecutioncontext.md): Per-call context delivered to a tool execution intercept.
- [Enum Builtin LlmCodec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/enum-builtinllmcodec.md): Relay's built-in LLM codec identities.
- [Enum LlmCodec Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/enum-llmcodecidentity.md): Per-call LLM codec identity supplied to sanitizer and SDK callbacks.
- [Enum LlmCollector](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/enum-llmcollector.md): Collector used to accumulate streaming response chunks.
- [Enum LlmFinalizer](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/enum-llmfinalizer.md): Finalizer used to synthesize the aggregate streaming response payload.
- [Trait LlmStream Inner](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/trait-llmstreaminner.md): Internal close-aware stream implementation.
- [Function resolve_parent_uuid](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/fn-resolve-parent-uuid.md): Resolve the active parent for a lifecycle operation. Resolve an explicit scope or the current active event as the parent.
- [Type Alias Conditional Middleware Guardrail Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-conditionalmiddlewareguardrailfn.md): Decide whether matching global runtime registrations remain eligible.
- [Type Alias Event Metadata Injector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-eventmetadatainjectorfn.md): Add flat metadata attributes to a fully constructed event.
- [Type Alias Event Sanitize Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-eventsanitizefn.md): Sanitize mutable observability fields on a fully constructed event.
- [Type Alias Event Subscriber Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-eventsubscriberfn.md): Consume runtime lifecycle events after they are emitted.
- [Type Alias LlmAsync Collector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmasynccollectorfn.md): Collector that is awaited; see `LlmCollector`.
- [Type Alias LlmAsync Finalizer Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmasyncfinalizerfn.md): Finalizer that is awaited; see `LlmFinalizer`.
- [Type Alias LlmBorrowed Collector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmborrowedcollectorfn.md): Collector that reads each provider JSON chunk without copying it.
- [Type Alias LlmCollector Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmcollectorfn.md): Per-chunk collector used by the streaming LLM runtime.
- [Type Alias LlmCollector Future](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmcollectorfuture.md): Future returned by an asynchronous collector.
- [Type Alias LlmConditional Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmconditionalfn.md): Decide whether an LLM call is allowed to continue.
- [Type Alias LlmExecution Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmexecutionfn.md): Wrap or replace non-streaming LLM execution.
- [Type Alias LlmExecution Next Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmexecutionnextfn.md): Continuation type invoked by non-streaming LLM execution intercepts.
- [Type Alias LlmFallible Finalizer Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmfalliblefinalizerfn.md): Finalizer that can fail; see `LlmFinalizer`.
- [Type Alias LlmFinalizer Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmfinalizerfn.md): Finalizer used to synthesize the aggregate streaming response payload.
- [Type Alias LlmFinalizer Future](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmfinalizerfuture.md): Future returned by an asynchronous finalizer.
- [Type Alias LlmRequest Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmrequestcontext.md): Request codec context exposed to an LLM execution intercept.
- [Type Alias LlmRequest Intercept Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmrequestinterceptfn.md): Rewrite or annotate an LLM request before execution.
- [Type Alias LlmResponse Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmresponsecontext.md): Response codec context exposed to a non-streaming LLM execution intercept.
- [Type Alias LlmSanitize Request Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmsanitizerequestfn.md): Sanitize an LLM request before the runtime records it.
- [Type Alias LlmSanitize Response Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmsanitizeresponsefn.md): Sanitize an LLM response before the runtime records it.
- [Type Alias LlmStream Execution Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmstreamexecutionfn.md): Wrap or replace streaming LLM execution.
- [Type Alias LlmStream Execution Next Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-llmstreamexecutionnextfn.md): Continuation type invoked by streaming LLM execution intercepts.
- [Type Alias Tool Conditional Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-toolconditionalfn.md): Decide whether a tool call is allowed to continue.
- [Type Alias Tool Execution Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-toolexecutionfn.md): Wrap or replace tool execution with access to the full call context.
- [Type Alias Tool Execution Next Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-toolexecutionnextfn.md): Continuation type invoked by tool execution intercepts.
- [Type Alias Tool Intercept Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-toolinterceptfn.md): Rewrite tool arguments before execution.
- [Type Alias Tool Sanitize Fn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/runtime/type-toolsanitizefn.md): Sanitize a tool request payload before the runtime records it.
- [Module scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope.md): Scope stack lifecycle and mark-event entry points.
- [Struct Create Scope Handle Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-createscopehandleparams.md): Builder parameters for `NemoRelayContextState::create_scope_handle`.
- [Struct Emit Mark Event Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-emitmarkeventparams.md): Builder parameters for `event`.
- [Struct Emit Metric Event Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-emitmetriceventparams.md): Builder parameters for `metric`.
- [Struct EndScope Handle Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-endscopehandleparams.md): Builder parameters for `NemoRelayContextState::build_scope_end_event`.
- [Struct PopScope Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-popscopeparams.md): Builder parameters for `pop_scope`.
- [Struct Push Scope Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-pushscopeparams.md): Builder parameters for `push_scope`.
- [Struct Scope Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-scopeattributes.md): Bitflags that modify scope behavior and observability.
- [Struct Scope Handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/struct-scopehandle.md): Runtime-owned handle identifying an active or completed scope.
- [Enum Handle Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/enum-handleattributes.md): Attribute bitflags attached to a concrete handle kind.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/enum-scopetype.md): Semantic category attached to a scope lifecycle span.
- [Constant COMPACTION_EVENT_NAME](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/constant-compaction-event-name.md): Canonical mark-event name used to indicate agent context compaction.
- [Function event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/fn-event.md): Emit a standalone mark event under the current or provided scope.
- [Function get_handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/fn-get-handle.md): Return the current scope at the top of the active stack.
- [Function metric](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/fn-metric.md): Emit a Relay metric mark under the current or provided scope.
- [Function pop_scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/fn-pop-scope.md): Pop the current scope from the active scope stack.
- [Function push_scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/scope/fn-push-scope.md): Push a new scope onto the active scope stack.
- [Module subscriber](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/subscriber.md): Global and scope-local event subscriber registration helpers.
- [Function deregister_subscriber](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/subscriber/fn-deregister-subscriber.md): Deregister a global lifecycle event subscriber.
- [Function flush_subscribers](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/subscriber/fn-flush-subscribers.md): Wait for all subscriber callbacks and managed terminal publications registered before this call to finish, including publications emitted transitively by those callbacks.
- [Function register_subscriber](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/subscriber/fn-register-subscriber.md): Register a global lifecycle event subscriber.
- [Function scope_deregister_subscriber](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/subscriber/fn-scope-deregister-subscriber.md): Deregister a scope-local lifecycle event subscriber.
- [Function scope_register_subscriber](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/subscriber/fn-scope-register-subscriber.md): Register a scope-local lifecycle event subscriber.
- [Module tool](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool.md): Tool lifecycle helpers and managed execution entry points.
- [Struct Create Tool Handle Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-createtoolhandleparams.md): Builder parameters for `NemoRelayContextState::create_tool_handle`.
- [Struct EndTool Handle Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-endtoolhandleparams.md): Builder parameters for `NemoRelayContextState::build_tool_end_event`.
- [Struct Tool Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolattributes.md): Bitflags that modify tool-call behavior and observability.
- [Struct Tool Call EndParams](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolcallendparams.md): Builder parameters for `tool_call_end`.
- [Struct Tool Call Execute Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolcallexecuteparams.md): Builder parameters for `tool_call_execute`.
- [Struct Tool Call Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolcallparams.md): Builder parameters for `tool_call`.
- [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept.
- [Struct Tool Execution Result](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolexecutionresult.md): Canonical application-visible result of tool execution.
- [Struct Tool Handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/struct-toolhandle.md): Runtime-owned handle identifying an active or completed tool call.
- [Constant TOOL_EXECUTION_INTERCEPT_OUTCOME_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/constant-tool-execution-intercept-outcome-schema.md): Versioned native-plugin JSON envelope schema for `ToolExecutionInterceptOutcome`.
- [Constant TOOL_EXECUTION_RESULT_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/constant-tool-execution-result-schema.md): Versioned native-plugin JSON envelope schema for `ToolExecutionResult`.
- [Function tool_call](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/fn-tool-call.md): Start a manual tool lifecycle span.
- [Function tool_call_end](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/fn-tool-call-end.md): Finish a manual tool lifecycle span.
- [Function tool_call_execute](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/fn-tool-call-execute.md): Execute a tool call through the managed middleware pipeline.
- [Function tool_conditional_execution](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/fn-tool-conditional-execution.md): Run only the tool conditional-execution guardrail chain.
- [Function tool_request_intercepts](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/api/tool/fn-tool-request-intercepts.md): Run only the tool request-intercept chain.
- [Module codec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/codec.md): Runtime normalization composes provider codecs with the configured pricing service.
- [Struct Runtime LlmNormalizer](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/codec/struct-runtimellmnormalizer.md): Provider normalization using the runtime's configured enrichment services.
- [Function response_codec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/codec/fn-response-codec.md): Built-in response codec enriched by this runtime's configured pricing service.
- [Module composition](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/composition.md): Services supplied by the SDK or an embedding application. Component services supplied by plugin-host or an embedding application.
- [Struct Runtime Services](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/composition/struct-runtimeservices.md): Composition callbacks owned by the embedding host, independent from the runtime engine.
- [Function install_runtime_services](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/composition/fn-install-runtime-services.md): Install composition once; subsequent initialization entry points preserve the chosen host.
- [Function services](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/composition/fn-services.md): Return the host services, or an uncomposed engine with no built-in components.
- [Type Alias Snapshot Sink](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/composition/type-snapshotsink.md): Callback receiving a resource snapshot without owning a collection implementation.
- [Module config_editor](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor.md): Shared configuration editor metadata.
- [Struct Editor Field Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/struct-editorfieldspec.md): Static editor metadata for one configuration field.
- [Struct Editor List Item Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/struct-editorlistitemspec.md): Recursive metadata for one list entry.
- [Struct Editor Schema](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/struct-editorschema.md): Static editor metadata for one configuration struct.
- [Struct Editor Tagged Union Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/struct-editortaggedunionspec.md): Metadata used to edit a tagged union value.
- [Struct Editor Variant Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/struct-editorvariantspec.md): One selectable variant of a tagged list entry.
- [Enum Editor Field Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/enum-editorfieldkind.md): Editor control shape for one configuration field.
- [Static JSON_LIST_ITEM](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/static-json-list-item.md): Reusable metadata for a list of arbitrary JSON values.
- [Static STRING_LIST_ITEM](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/static-string-list-item.md): Reusable metadata for a list of strings.
- [Trait Editor Config](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/trait-editorconfig.md): Trait implemented by configuration structs that expose editor metadata.
- [Function default_json_list_item_value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/fn-default-json-list-item-value.md): Default value for a newly added arbitrary JSON list item.
- [Function default_string_list_item_value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/config_editor/fn-default-string-list-item-value.md): Default value for a newly added string list item.
- [Module error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/error.md): Shared runtime errors, preserved at the core import path.
- [Struct Upstream Failure](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/error/struct-upstreamfailure.md): Structured failure returned by one upstream provider attempt.
- [Enum Flow Error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/error/enum-flowerror.md): The error type for all NeMo Relay runtime operations.
- [Enum Upstream Failure Class](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/error/enum-upstreamfailureclass.md): Stable classification for a failure from an upstream provider attempt.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/error/type-result.md): A specialized `Result` type for NeMo Relay operations.
- [Module json](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/json.md): JSON utilities for the NeMo Relay runtime.
- [Function merge_json](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/json/fn-merge-json.md): Shallow-merge two optional JSON values.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/json/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.
- [Module pricing](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/pricing.md): Runtime pricing service adapters. Host-supplied model pricing without a dependency on a pricing implementation.
- [Function active_pricing_resolver](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/pricing/fn-active-pricing-resolver.md): Capture a consistent resolver for one finalization operation.
- [Function attach_estimated_cost_for_provider](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/pricing/fn-attach-estimated-cost-for-provider.md): Attach missing cost information using the host's pricing implementation.
- [Function infer_model_provider](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/pricing/fn-infer-model-provider.md): Infer the catalog provider for a normalized model.
- [Module registry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/registry.md): Priority-sorted named registry.
- [Struct Sorted Registry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/registry/struct-sortedregistry.md): A named registry that maintains a sorted order by priority.
- [Trait Registry Entry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/registry/trait-registryentry.md): A named, priority-ordered registry entry.
- [Module stream](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/stream.md): Streaming LLM response wrapper.
- [Struct LlmStream Wrapper](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/stream/struct-llmstreamwrapper.md): Wraps an inner `Stream<Item = Result<Json>>` of raw chunks and:
- [Macro editor_config](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-runtime/macro-editor-config.md): Declare typed configuration editor metadata. Implements [`EditorConfig`] for a configuration type.