> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# APIs

Use these generated library references for symbol-level API documentation.

Use the generated reference when you already know which public symbol you need.
Do not treat generated reference pages as the source of truth for runtime
semantics such as:

* Ownership
* Managed execution ordering
* Cleanup boundaries
* Middleware behavior
* Support boundaries

For those topics, start with [Concepts](/about-nemo-relay/concepts), the
[Agent Runtime Primer](/getting-started/agent-runtime-primer), or the
workflow-specific documentation path that matches the boundary you own.

Primary binding references:

* [Python Library Reference](/reference/api/python-library-reference)
* [Node.js Library Reference](/reference/api/nodejs-library-reference)
* [Rust Library Reference](/reference/api/rust-library-reference)

## Docs

- [Python Library Reference](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference.md): Generated Python API reference for NeMo Relay packages.
- [nemo_relay](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay.md): Python bindings for the NeMo Relay runtime.
- [nemo_relay.adaptive](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/adaptive.md): Adaptive plugin configuration helpers.
- [nemo_relay.codecs](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/codecs.md): Protocol definitions for request and response codecs used by `nemo_relay.llm`.
- [nemo_relay.guardrails](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/guardrails.md): Global guardrail registration for tools and LLMs.
- [nemo_relay.integrations](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations.md): Optional integrations for NeMo Relay.
- [nemo_relay.integrations.deepagents](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/deepagents.md): NeMo Relay integrations for Deep Agents.
- [nemo_relay.integrations.deepagents.callbacks](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/deepagents/callbacks.md): Deep Agents callback handler for NeMo Relay observability.
- [nemo_relay.integrations.deepagents.middleware](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/deepagents/middleware.md): Deep Agents middleware for NeMo Relay observability.
- [nemo_relay.integrations.langchain](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/langchain.md): NeMo Relay integrations for LangChain.
- [nemo_relay.integrations.langchain.callbacks](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/langchain/callbacks.md): LangChain callback handler that maps run hierarchy to NeMo Relay scopes.
- [nemo_relay.integrations.langchain.middleware](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/langchain/middleware.md): LangChain AgentMiddleware implementation for NeMo Relay.
- [nemo_relay.integrations.langgraph](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/langgraph.md): NeMo Relay integrations for LangGraph.
- [nemo_relay.integrations.langgraph.callbacks](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/integrations/langgraph/callbacks.md): LangGraph callback handler that reuses the LangChain NeMo Relay integration.
- [nemo_relay.intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/intercepts.md): Global middleware intercept registration for tools and LLMs.
- [nemo_relay.llm](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/llm.md): LLM lifecycle helpers for non-streaming and streaming calls.
- [nemo_relay.model_pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/model-pricing.md): Model pricing plugin configuration helpers.
- [nemo_relay.observability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/observability.md): Observability plugin configuration helpers.
- [nemo_relay.pii_redaction](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/pii-redaction.md): PII redaction plugin configuration helpers.
- [nemo_relay.plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/plugin.md): Generic plugin configuration and registration helpers.
- [nemo_relay.scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/scope.md): Scope stack operations.
- [nemo_relay.scope_local](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/scope-local.md): Scope-local middleware and subscriber registration.
- [nemo_relay.subscribers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/subscribers.md): Global event subscriber registration.
- [nemo_relay.tools](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/tools.md): Tool lifecycle helpers.
- [nemo_relay.typed](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/typed.md): Typed wrappers around the JSON-based NeMo Relay execution APIs.
- [nemo_relay.utils](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay/utils.md): 
- [nemo_relay_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/python-library-reference/nemo-relay-plugin.md): Author out-of-process NeMo Relay worker plugins in Python.
- [Node.js Library Reference](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference.md): Generated Node.js API reference for the nemo-relay-node package.
- [Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node.md): Main runtime lifecycle, scope, middleware, subscriber, and exporter APIs.
- [Typed Helpers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node-typed.md): Typed wrappers for NeMo Relay Node.js execute APIs.
- [Plugin Helpers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node-plugin.md): Plugin configuration, validation, activation, and registration helpers.
- [Adaptive Helpers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node-adaptive.md): Adaptive plugin configuration helpers.
- [Observability Helpers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node-observability.md): Observability plugin configuration helpers.
- [nemo-relay-node/pii_redaction](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node-pii-redaction.md): Declarations exported by `nemo-relay-node/pii_redaction`.
- [nemo-relay-node/model_pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/nodejs-library-reference/nemo-relay-node-model-pricing.md): Declarations exported by `nemo-relay-node/model_pricing`.
- [Rust Library Reference](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference.md): Generated Rust API reference for NeMo Relay crates.
- [nemo-relay](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay.md): NeMo Relay Core
- [Module api](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api.md): Public API for the NeMo Relay runtime.
- [Module event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event.md): Lifecycle event types and builder-backed event constructors. Event types for Agent Trajectory Observability Format (ATOF) runtime events.
- [Struct Base Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-baseevent.md): Shared event metadata carried by every ATOF event.
- [Struct Category Profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-categoryprofile.md): Category-specific profile data.
- [Struct Data Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-dataschema.md): Identifier for the schema that describes an event's opaque `data` payload.
- [Struct Event Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-eventcategory.md): Semantic category carried by ATOF `category`.
- [Struct Mark Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-markevent.md): ATOF point-in-time mark event.
- [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner.
- [Struct Scope Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/struct-scopeevent.md): ATOF scope lifecycle event.
- [Enum Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime.
- [Enum Scope Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/enum-scopecategory.md): Agent Trajectory Observability Format (ATOF) lifecycle phase for a scope event.
- [Constant ATOF_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/constant-atof-version.md): Agent Trajectory Observability Format (ATOF) protocol version emitted by this runtime.
- [Trait Event Normalization Ext](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/trait-eventnormalizationext.md): Core-only normalized LLM accessors for ATOF events.
- [Function attributes_from_handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-attributes-from-handle.md): Convert handle bitflags into ATOF attributes.
- [Function llm_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-llm-attributes-to-strings.md): Convert LLM bitflags into ATOF attributes.
- [Function scope_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-scope-attributes-to-strings.md): Convert scope bitflags into ATOF attributes.
- [Function tool_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/event/fn-tool-attributes-to-strings.md): Convert tool bitflags into ATOF attributes.
- [Module llm](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm.md): LLM lifecycle helpers and managed execution entry points.
- [Struct Create LlmHandle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-createllmhandleparams.md): Builder parameters for `NemoRelayContextState::create_llm_handle`.
- [Struct EndLlm Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-endllmhandleparams.md): Builder parameters for `NemoRelayContextState::build_llm_end_event`.
- [Struct LlmAttributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmattributes.md): Bitflags that modify LLM-call behavior and observability.
- [Struct LlmCall EndParams](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallendparams.md): Builder parameters for `llm_call_end`.
- [Struct LlmCall Execute Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallexecuteparams.md): Builder parameters for `llm_call_execute`.
- [Struct LlmCall Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmcallparams.md): Builder parameters for `llm_call`.
- [Struct LlmHandle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmhandle.md): Runtime-owned handle identifying an active or completed LLM call.
- [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime.
- [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks.
- [Struct LlmStream Call Execute Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/struct-llmstreamcallexecuteparams.md): Builder parameters for `llm_stream_call_execute`.
- [Function llm_call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call.md): Start a manual LLM lifecycle span.
- [Function llm_call_end](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-end.md): Finish a manual LLM lifecycle span.
- [Function llm_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-call-execute.md): Execute an LLM call through the managed middleware pipeline.
- [Function llm_conditional_execution](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-conditional-execution.md): Run only the LLM conditional-execution guardrail chain.
- [Function llm_request_intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-request-intercepts.md): Run only the LLM request-intercept chain.
- [Function llm_stream_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/llm/fn-llm-stream-call-execute.md): Execute a streaming LLM call through the managed middleware pipeline.
- [Module registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry.md): Global and scope-local middleware registration helpers. Middleware registry helpers for global and scope-local guardrails, intercepts, and subscribers.
- [Function deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-conditional-execution-guardrail.md): Deregister a global LLM conditional-execution guardrail.
- [Function deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-execution-intercept.md): Deregister a global LLM execution intercept.
- [Function deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-request-intercept.md): Deregister a global LLM request intercept.
- [Function deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-sanitize-request-guardrail.md): Deregister a global LLM sanitize-request guardrail.
- [Function deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-sanitize-response-guardrail.md): Deregister a global LLM sanitize-response guardrail.
- [Function deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-llm-stream-execution-intercept.md): Deregister a global streaming LLM execution intercept.
- [Function deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-conditional-execution-guardrail.md): Deregister a global tool conditional-execution guardrail.
- [Function deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-execution-intercept.md): Deregister a global tool execution intercept.
- [Function deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-request-intercept.md): Deregister a global tool request intercept.
- [Function deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-sanitize-request-guardrail.md): Deregister a global tool sanitize-request guardrail.
- [Function deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-deregister-tool-sanitize-response-guardrail.md): Deregister a global tool sanitize-response guardrail.
- [Function register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-conditional-execution-guardrail.md): Register a global LLM conditional-execution guardrail. The guardrail can block LLM execution before intercepts or the provider callback run.
- [Function register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-execution-intercept.md): Register a global LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback.
- [Function register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-request-intercept.md): Register a global LLM request intercept. Request intercepts can rewrite or annotate the outgoing LLM request and schedule lifecycle marks for the resulting LLM scope.
- [Function register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-sanitize-request-guardrail.md): Register a global LLM sanitize-request guardrail. The guardrail rewrites only the request payload recorded on emitted start events.
- [Function register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-sanitize-response-guardrail.md): Register a global LLM sanitize-response guardrail. The guardrail rewrites only the response payload recorded on emitted end events.
- [Function register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-llm-stream-execution-intercept.md): Register a global streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback.
- [Function register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-conditional-execution-guardrail.md): Register a global tool conditional-execution guardrail. The guardrail can block tool execution before intercepts or the tool callback run.
- [Function register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-execution-intercept.md): Register a global tool execution intercept. Execution intercepts can wrap or replace the tool callback. Each callback returns a canonical tool execution outcome, while its continuation resolves to the raw downstream result JSON.
- [Function register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-request-intercept.md): Register a global tool request intercept. Request intercepts can rewrite tool arguments before execution.
- [Function register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-sanitize-request-guardrail.md): Register a global tool sanitize-request guardrail. The guardrail rewrites only the tool input recorded on emitted start events.
- [Function register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-register-tool-sanitize-response-guardrail.md): Register a global tool sanitize-response guardrail. The guardrail rewrites only the tool output recorded on emitted end events.
- [Function scope_deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-conditional-execution-guardrail.md): Deregister a scope-local LLM conditional-execution guardrail.
- [Function scope_deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-execution-intercept.md): Deregister a scope-local LLM execution intercept.
- [Function scope_deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-request-intercept.md): Deregister a scope-local LLM request intercept.
- [Function scope_deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-sanitize-request-guardrail.md): Deregister a scope-local LLM sanitize-request guardrail.
- [Function scope_deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-sanitize-response-guardrail.md): Deregister a scope-local LLM sanitize-response guardrail.
- [Function scope_deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-llm-stream-execution-intercept.md): Deregister a scope-local streaming LLM execution intercept.
- [Function scope_deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-conditional-execution-guardrail.md): Deregister a scope-local tool conditional-execution guardrail.
- [Function scope_deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-execution-intercept.md): Deregister a scope-local tool execution intercept.
- [Function scope_deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-request-intercept.md): Deregister a scope-local tool request intercept.
- [Function scope_deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-sanitize-request-guardrail.md): Deregister a scope-local tool sanitize-request guardrail.
- [Function scope_deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-deregister-tool-sanitize-response-guardrail.md): Deregister a scope-local tool sanitize-response guardrail.
- [Function scope_register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-conditional-execution-guardrail.md): Register a scope-local LLM conditional-execution guardrail. The guardrail can block LLM execution inside the owning scope.
- [Function scope_register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-execution-intercept.md): Register a scope-local LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback inside the owning scope.
- [Function scope_register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-request-intercept.md): Register a scope-local LLM request intercept. Request intercepts can rewrite or annotate LLM requests inside the owning scope and schedule lifecycle marks for the resulting LLM scope.
- [Function scope_register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-sanitize-request-guardrail.md): Register a scope-local LLM sanitize-request guardrail. The guardrail rewrites only request payloads emitted under the owning scope.
- [Function scope_register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-sanitize-response-guardrail.md): Register a scope-local LLM sanitize-response guardrail. The guardrail rewrites only response payloads emitted under the owning scope.
- [Function scope_register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-llm-stream-execution-intercept.md): Register a scope-local streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback inside the owning scope.
- [Function scope_register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-conditional-execution-guardrail.md): Register a scope-local tool conditional-execution guardrail. The guardrail can block tool execution inside the owning scope.
- [Function scope_register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-execution-intercept.md): Register a scope-local tool execution intercept. Execution intercepts can wrap or replace the tool callback inside the owning scope. Each callback returns a canonical tool execution outcome, while its continuation resolves to the raw downstream result JSON.
- [Function scope_register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-request-intercept.md): Register a scope-local tool request intercept. Request intercepts can rewrite tool arguments inside the owning scope.
- [Function scope_register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-sanitize-request-guardrail.md): Register a scope-local tool sanitize-request guardrail. The guardrail rewrites only tool input emitted under the owning scope.
- [Function scope_register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/registry/fn-scope-register-tool-sanitize-response-guardrail.md): Register a scope-local tool sanitize-response guardrail. The guardrail rewrites only tool output emitted under the owning scope.
- [Module runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime.md): Advanced runtime state, callbacks, and scope-stack helpers. Advanced runtime state, callbacks, and scope-stack helpers.
- [Module callbacks](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks.md): Callback type aliases used by the runtime middleware pipeline.
- [Type Alias Event Subscriber Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-eventsubscriberfn.md): Consume runtime lifecycle events after they are emitted.
- [Type Alias LlmCollector Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmcollectorfn.md): Per-chunk collector used by the streaming LLM runtime.
- [Type Alias LlmConditional Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmconditionalfn.md): Decide whether an LLM call is allowed to continue.
- [Type Alias LlmExecution Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmexecutionfn.md): Wrap or replace non-streaming LLM execution.
- [Type Alias LlmExecution Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmexecutionnextfn.md): Continuation type invoked by non-streaming LLM execution intercepts.
- [Type Alias LlmFinalizer Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmfinalizerfn.md): Finalizer used to synthesize the aggregate streaming response payload.
- [Type Alias LlmJson Stream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmjsonstream.md): Stream of JSON chunks produced by the managed streaming LLM pipeline.
- [Type Alias LlmRequest Intercept Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmrequestinterceptfn.md): Rewrite or annotate an LLM request before execution.
- [Type Alias LlmSanitize Request Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmsanitizerequestfn.md): Sanitize an LLM request before the runtime records it.
- [Type Alias LlmSanitize Response Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmsanitizeresponsefn.md): Sanitize an LLM response before the runtime records it.
- [Type Alias LlmStream Execution Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmstreamexecutionfn.md): Wrap or replace streaming LLM execution.
- [Type Alias LlmStream Execution Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-llmstreamexecutionnextfn.md): Continuation type invoked by streaming LLM execution intercepts.
- [Type Alias Tool Conditional Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolconditionalfn.md): Decide whether a tool call is allowed to continue.
- [Type Alias Tool Execution Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolexecutionfn.md): Wrap or replace tool execution.
- [Type Alias Tool Execution Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolexecutionnextfn.md): Continuation type invoked by tool execution intercepts.
- [Type Alias Tool Intercept Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolinterceptfn.md): Rewrite tool arguments before execution.
- [Type Alias Tool Sanitize Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/callbacks/type-toolsanitizefn.md): Sanitize a tool request payload before the runtime records it.
- [Module global](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/global.md): Process-global access to the shared runtime context state.
- [Function global_context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/global/fn-global-context.md): Return the process-global runtime context state handle.
- [Module scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack.md): Scope stack storage and propagation helpers.
- [Struct Scope Stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/struct-scopestack.md): Mutable stack of active scopes plus their scope-local registries.
- [Struct Thread Scope Stack Binding](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/struct-threadscopestackbinding.md): Captured thread-local scope stack binding.
- [Static TASK_SCOPE_STACK](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/static-task-scope-stack.md): Task-local scope stack handle used by async execution contexts.
- [Function capture_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-capture-thread-scope-stack.md): Capture the current thread-local scope stack binding.
- [Function create_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-create-scope-stack.md): Create a new scope stack handle with an implicit root scope.
- [Function current_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-current-scope-stack.md): Return the scope stack visible to the current execution context.
- [Function propagate_scope_to_thread](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-propagate-scope-to-thread.md): Capture the current scope stack handle for use in another thread.
- [Function restore_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-restore-thread-scope-stack.md): Restore a previously captured thread-local scope stack binding.
- [Function scope_stack_active](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-scope-stack-active.md): Report whether the current context has an explicitly active scope stack.
- [Function set_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-set-thread-scope-stack.md): Install an explicit scope stack for the current thread.
- [Function sync_thread_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-sync-thread-scope-stack.md): Synchronize the thread-local scope stack without marking it explicit.
- [Function task_scope_push](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-task-scope-push.md): Push a scope handle onto the active stack.
- [Function task_scope_remove](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-task-scope-remove.md): Remove a scope handle from the active stack.
- [Function task_scope_top](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-task-scope-top.md): Clone the current top-most scope handle from the active stack.
- [Function with_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/fn-with-scope-stack.md): Run a synchronous callback with `handle` as the visible scope stack.
- [Type Alias Scope Stack Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/scope_stack/type-scopestackhandle.md): Shared handle type for the runtime scope stack.
- [Module state](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/state.md): Process-global runtime state and middleware-chain builders.
- [Struct Nemo Relay Context State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/state/struct-nemorelaycontextstate.md): Process-global runtime state backing middleware and event emission.
- [Module subscriber_dispatcher](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/subscriber_dispatcher.md): Asynchronous subscriber delivery for native targets.
- [Function flush_subscribers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/runtime/subscriber_dispatcher/fn-flush-subscribers.md): Wait for all queued subscriber callbacks submitted before this call.
- [Module scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope.md): Scope stack lifecycle and mark-event entry points.
- [Struct Create Scope Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-createscopehandleparams.md): Builder parameters for `NemoRelayContextState::create_scope_handle`.
- [Struct Emit Mark Event Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-emitmarkeventparams.md): Builder parameters for `event`.
- [Struct EndScope Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-endscopehandleparams.md): Builder parameters for `NemoRelayContextState::build_scope_end_event`.
- [Struct PopScope Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-popscopeparams.md): Builder parameters for `pop_scope`.
- [Struct Push Scope Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-pushscopeparams.md): Builder parameters for `push_scope`.
- [Struct Scope Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-scopeattributes.md): Bitflags that modify scope behavior and observability.
- [Struct Scope Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/struct-scopehandle.md): Runtime-owned handle identifying an active or completed scope.
- [Enum Handle Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/enum-handleattributes.md): Attribute bitflags attached to a concrete handle kind.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/enum-scopetype.md): Semantic category attached to a scope lifecycle span.
- [Function event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-event.md): Emit a standalone mark event under the current or provided scope.
- [Function get_handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-get-handle.md): Return the current scope at the top of the active stack.
- [Function pop_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-pop-scope.md): Pop the current scope from the active scope stack.
- [Function push_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/scope/fn-push-scope.md): Push a new scope onto the active scope stack.
- [Module subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber.md): Global and scope-local event subscriber registration helpers.
- [Function deregister_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-deregister-subscriber.md): Deregister a global lifecycle event subscriber.
- [Function flush_subscribers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-flush-subscribers.md): Wait for all subscriber callbacks queued before this call to finish.
- [Function register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-register-subscriber.md): Register a global lifecycle event subscriber.
- [Function scope_deregister_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-scope-deregister-subscriber.md): Deregister a scope-local lifecycle event subscriber.
- [Function scope_register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/subscriber/fn-scope-register-subscriber.md): Register a scope-local lifecycle event subscriber.
- [Module tool](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool.md): Tool lifecycle helpers and managed execution entry points.
- [Struct Create Tool Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-createtoolhandleparams.md): Builder parameters for `NemoRelayContextState::create_tool_handle`.
- [Struct EndTool Handle Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-endtoolhandleparams.md): Builder parameters for `NemoRelayContextState::build_tool_end_event`.
- [Struct Tool Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolattributes.md): Bitflags that modify tool-call behavior and observability.
- [Struct Tool Call EndParams](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolcallendparams.md): Builder parameters for `tool_call_end`.
- [Struct Tool Call Execute Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolcallexecuteparams.md): Builder parameters for `tool_call_execute`.
- [Struct Tool Call Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolcallparams.md): Builder parameters for `tool_call`.
- [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept.
- [Struct Tool Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/struct-toolhandle.md): Runtime-owned handle identifying an active or completed tool call.
- [Function tool_call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call.md): Start a manual tool lifecycle span.
- [Function tool_call_end](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call-end.md): Finish a manual tool lifecycle span.
- [Function tool_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-call-execute.md): Execute a tool call through the managed middleware pipeline.
- [Function tool_conditional_execution](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-conditional-execution.md): Run only the tool conditional-execution guardrail chain.
- [Function tool_request_intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/api/tool/fn-tool-request-intercepts.md): Run only the tool request-intercept chain.
- [Module codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec.md): LLM codec types, traits, and built-in implementations.
- [Module anthropic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/anthropic.md): Built-in codec for the Anthropic Messages API.
- [Struct Anthropic Messages Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/anthropic/struct-anthropicmessagescodec.md): Built-in codec for the Anthropic Messages API.
- [Struct Anthropic Messages Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/anthropic/struct-anthropicmessagesstreamingcodec.md): Streaming counterpart to `AnthropicMessagesCodec`.
- [Module model_pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing.md): Data-driven LLM model pricing used to layer cost estimates onto usage.
- [Enum Cache Read Accounting](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-cachereadaccounting.md): How cache-read tokens relate to prompt token counts in provider usage.
- [Struct Model Pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-modelpricing.md): Per-token model pricing expressed in USD per one million tokens.
- [Struct Pricing Catalog](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingcatalog.md): Collection of model pricing entries.
- [Enum Pricing Catalog Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingcatalogerror.md): Errors produced while parsing or validating a model pricing catalog.
- [Struct Pricing Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingconfig.md): Runtime model pricing resolver configuration.
- [Struct Pricing Resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingresolver.md): Ordered model pricing lookup chain.
- [Struct Token Rate Tier](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenratetier.md): A model pricing tier selected by prompt/input token count.
- [Trait Pricing Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/trait-pricingsource.md): Pluggable model pricing source interface.
- [Enum Pricing Source Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingsourceconfig.md): Declarative model pricing source supported by Relay configuration.
- [Enum Pricing Unit](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingunit.md): Billing unit represented by a model pricing entry.
- [Struct Prompt Cache Pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-promptcachepricing.md): Prompt-cache accounting rules for a model pricing entry.
- [Struct Token Pricing Rates](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenpricingrates.md): Token rates expressed as USD per one million tokens.
- [Enum Rate Schedule Application](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-ratescheduleapplication.md): How a selected rate-schedule tier applies to billable usage.
- [Function active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-active-pricing-resolver.md): Returns the active process-wide model pricing resolver.
- [Enum Token Rate Schedule](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-tokenrateschedule.md): Data-driven token rate schedule for model pricing with request thresholds.
- [Function attach_estimated_cost](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost.md): Adds a model pricing estimate to a normalized response when cost is missing.
- [Function attach_estimated_cost_for_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost-for-provider.md): Adds a provider-aware model pricing estimate to a normalized response when cost is missing.
- [Function estimate_cost](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost.md): Estimates USD cost for a model/usage pair when model pricing is known.
- [Function estimate_cost_for_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-for-provider.md): Estimates USD cost for a provider/model pair when model pricing is known.
- [Function estimate_cost_with_catalog](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-catalog.md): Estimates USD cost using the provided catalog.
- [Function estimate_cost_with_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-provider.md): Estimates USD cost using the provided catalog and provider/model pair.
- [Function infer_model_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-infer-model-provider.md): Infers a provider/route value for a decoded model.
- [Function pricing_for_model](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-model.md): Returns known model pricing for a model ID.
- [Function pricing_for_provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-provider.md): Returns known model pricing for a provider/model pair.
- [Function reset_active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-reset-active-pricing-resolver.md): Restores the active process-wide model pricing resolver to an empty resolver.
- [Function set_active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-set-active-pricing-resolver.md): Replaces the active process-wide model pricing resolver.
- [Module openai_chat](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_chat.md): Built-in codec for the OpenAI Chat Completions API.
- [Struct OpenAI Chat Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_chat/struct-openaichatcodec.md): Built-in codec for the OpenAI Chat Completions API.
- [Struct OpenAI Chat Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_chat/struct-openaichatstreamingcodec.md): Streaming counterpart to `OpenAIChatCodec`.
- [Module openai_responses](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_responses.md): Built-in codec for the OpenAI Responses API.
- [Struct OpenAI Responses Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_responses/struct-openairesponsescodec.md): Built-in codec for the OpenAI Responses API.
- [Struct OpenAI Responses Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/openai_responses/struct-openairesponsesstreamingcodec.md): Streaming counterpart to `OpenAIResponsesCodec`.
- [Module request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request.md): Re-exported normalized LLM request data types.
- [Struct Annotated LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-annotatedllmrequest.md): Structured view of an LLM request, produced by a Codec from opaque `LlmRequest` content.
- [Struct Function Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-functioncall.md): A function call within a tool call.
- [Struct Function Definition](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-functiondefinition.md): A function definition within a tool definition.
- [Struct Generation Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-generationparams.md): Normalized generation parameters across providers.
- [Struct Open AiImage Url](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-openaiimageurl.md): OpenAI image URL payload.
- [Struct Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-toolcall.md): A tool call requested by the assistant.
- [Struct Tool Choice Function](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-toolchoicefunction.md): A specific tool choice that forces a named function.
- [Struct Tool Choice Function Name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-toolchoicefunctionname.md): The name component of a specific tool choice.
- [Struct Tool Definition](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/struct-tooldefinition.md): A tool definition (function schema) available to the model.
- [Enum Content Part](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-contentpart.md): A single content part within a multimodal message.
- [Enum Message](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-message.md): A single message in a conversation, tagged by role.
- [Enum Message Content](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-messagecontent.md): Message content: either a plain string or multimodal parts array.
- [Enum Tool Choice](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/request/enum-toolchoice.md): Tool choice control: how the model should use available tools.
- [Module resolve](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve.md): Provider-surface detection and best-effort normalization: the preferred path for turning raw provider JSON into normalized types when no codec annotation is present.
- [Enum Provider Surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/enum-providersurface.md): A built-in provider request/response surface.
- [Function detect_request_surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-detect-request-surface.md): Detect the request surface from a raw request body by top-level key.
- [Function detect_request_surface_with_hint](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-detect-request-surface-with-hint.md): Like `detect_request_surface`, but a recognized `provider_hint` resolves the one ambiguous shape (an Anthropic request without a top-level `system`, otherwise read as OpenAI Chat). Today, only the exact hints `"anthropic"` and `"anthropic.messages"` change detection; `None` or any other value is ignored and detection stays shape-only.
- [Function detect_response_surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-detect-response-surface.md): Detect the response surface from a raw provider response, classifying only when exactly one built-in shape matches (the built-in codecs accept minimal objects, so decode success alone is not a reliable classifier).
- [Function normalize_request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-normalize-request.md): Best-effort decode of a raw request into `AnnotatedLlmRequest` (fail-open).
- [Function normalize_request_with_hint](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-normalize-request-with-hint.md): Like `normalize_request`, but a recognized `provider_hint` can disambiguate provider request shapes that are otherwise identical.
- [Function normalize_response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/resolve/fn-normalize-response.md): Best-effort decode of a raw response into `AnnotatedLlmResponse` (fail-open).
- [Module response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response.md): Re-exported normalized LLM response data types and core pricing helpers.
- [Struct Annotated LlmResponse](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-annotatedllmresponse.md): Structured view of an LLM response, produced by a response codec from raw JSON API output.
- [Struct Cost Estimate](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-costestimate.md): Normalized LLM response cost.
- [Struct Response Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-responsetoolcall.md): A tool call requested by the model in its response.
- [Struct Usage](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/struct-usage.md): Token usage statistics from an LLM API response.
- [Enum ApiSpecific Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/enum-apispecificresponse.md): API-specific response data that cannot be normalized across providers.
- [Enum Cost Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/enum-costsource.md): Source of a normalized cost value.
- [Enum Finish Reason](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/response/enum-finishreason.md): Normalized reason why the model stopped generating.
- [Module streaming](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming.md): Streaming response codecs for the managed LLM execution pipeline.
- [Struct SseEvent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming/struct-sseevent.md): One decoded SSE frame, paired with the parsed `data:` payload.
- [Struct SseEvent Decoder](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming/struct-sseeventdecoder.md): Incremental decoder for `text/event-stream` byte streams that yields one JSON object per complete `data:` payload.
- [Trait Streaming Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/streaming/trait-streamingcodec.md): Per-provider streaming codec used with `crate::api::llm::llm_stream_call_execute`.
- [Module traits](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/traits.md): LLM codec traits for bidirectional request translation.
- [Trait LlmCodec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/traits/trait-llmcodec.md): A bidirectional translator between opaque `LlmRequest` content and structured `AnnotatedLlmRequest`.
- [Trait LlmResponse Codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/codec/traits/trait-llmresponsecodec.md): Decode-only codec for LLM API responses.
- [Module config_editor](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor.md): Typed configuration editor metadata.
- [Struct Editor Field Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/struct-editorfieldspec.md): Static editor metadata for one configuration field.
- [Struct Editor Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/struct-editorschema.md): Static editor metadata for one configuration struct.
- [Enum Editor Field Kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/enum-editorfieldkind.md): Editor control shape for one configuration field.
- [Trait Editor Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/config_editor/trait-editorconfig.md): Trait implemented by configuration structs that expose editor metadata.
- [Module error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/error.md): Error types for the NeMo Relay runtime.
- [Enum Flow Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/error/enum-flowerror.md): The error type for all NeMo Relay runtime operations.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/error/type-result.md): A specialized `Result` type for NeMo Relay operations.
- [Module json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/json.md): JSON utilities for the NeMo Relay runtime.
- [Function merge_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/json/fn-merge-json.md): Shallow-merge two optional JSON values.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/json/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.
- [Module observability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability.md): Optional observability integrations for NeMo Relay Core.
- [Module atif](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif.md): Agent Trajectory Interchange Format (ATIF) exporter.
- [Struct Atif Agent Info](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifagentinfo.md): Information about the agent that produced the trajectory.
- [Struct Atif Ancestry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifancestry.md): Lineage node identifying a callable within an ATIF step.
- [Struct Atif Exporter](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifexporter.md): Collects lifecycle events and exports them as ATIF trajectories.
- [Struct Atif Final Metrics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atiffinalmetrics.md): Aggregate statistics for the entire trajectory (ATIF final_metrics).
- [Struct Atif Invocation Info](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifinvocationinfo.md): Invocation timing and correlation metadata for one execution occurrence.
- [Struct Atif Metrics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifmetrics.md): Token usage and cost metrics for a single step.
- [Struct Atif Observation](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifobservation.md): Observation results from tool execution.
- [Struct Atif Observation Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifobservationresult.md): A single observation result from a tool call.
- [Struct Atif Step](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifstep.md): A single step in an ATIF trajectory.
- [Struct Atif Step Extra](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifstepextra.md): Lineage payload serialized into ATIF `Step.extra`.
- [Struct Atif Subagent Trajectory Ref](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atifsubagenttrajectoryref.md): Reference to a delegated subagent trajectory.
- [Struct Atif Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atiftoolcall.md): A tool call made by the agent.
- [Struct Atif Trajectory](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/struct-atiftrajectory.md): A complete ATIF trajectory.
- [Constant ATIF_SCHEMA_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atif/constant-atif-schema-version.md): The ATIF schema version string embedded in all exported trajectories.
- [Module atof](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof.md): Agent Trajectory Observability Format (ATOF) JSONL exporter support for NeMo Flow.
- [Struct Atof Endpoint Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/struct-atofendpointconfig.md): Streaming destination for raw ATOF events.
- [Struct Atof Exporter](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/struct-atofexporter.md): Filesystem-backed Agent Trajectory Observability Format (ATOF) JSONL event exporter.
- [Struct Atof Exporter Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/struct-atofexporterconfig.md): Configuration for `AtofExporter`.
- [Enum Atof Endpoint Field Name Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofendpointfieldnamepolicy.md): Field name transformation policy used before sending events to an endpoint.
- [Enum Atof Endpoint Transport](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofendpointtransport.md): Streaming transport used by an ATOF endpoint.
- [Enum Atof Exporter Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofexportererror.md): Errors produced while configuring or operating the ATOF JSONL exporter.
- [Enum Atof Exporter Mode](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/enum-atofexportermode.md): File write behavior for `AtofExporter`.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/atof/type-result.md): Result type for the ATOF JSONL exporter.
- [Module openinference](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference.md): OpenInference subscriber support for NeMo Relay.
- [Struct Open Inference Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/struct-openinferenceconfig.md): Configuration for the OpenInference subscriber.
- [Struct Open Inference Subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/struct-openinferencesubscriber.md): OpenInference-backed NeMo Relay subscriber.
- [Enum Open Inference Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/enum-openinferenceerror.md): Errors produced while configuring or operating the OpenInference subscriber.
- [Enum Otlp Transport](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/enum-otlptransport.md): Supported OTLP trace transports.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/openinference/type-result.md): Result type for the OpenInference subscriber crate.
- [Module otel](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel.md): OpenTelemetry subscriber support for NeMo Relay.
- [Struct Open Telemetry Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/struct-opentelemetryconfig.md): Configuration for the OpenTelemetry subscriber.
- [Struct Open Telemetry Subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/struct-opentelemetrysubscriber.md): OpenTelemetry-backed NeMo Relay subscriber.
- [Enum Open Telemetry Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/enum-opentelemetryerror.md): Errors produced while configuring or operating the OpenTelemetry subscriber.
- [Enum Otlp Transport](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/enum-otlptransport.md): Supported OTLP trace transports.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/otel/type-result.md): Result type for the OpenTelemetry subscriber crate.
- [Module plugin_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component.md): Built-in observability plugin component.
- [Struct Atif Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-atifsectionconfig.md): Per-trajectory ATIF exporter config.
- [Struct Atof Endpoint Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-atofendpointsectionconfig.md): Streaming destination for raw ATOF events.
- [Struct Atof Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-atofsectionconfig.md): Filesystem-backed ATOF JSONL exporter config.
- [Struct Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-componentspec.md): Top-level observability component wrapper.
- [Struct Http Storage Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-httpstorageconfig.md): HTTP endpoint settings for ATIF trajectory upload.
- [Struct Observability Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-observabilityconfig.md): Canonical config document for the observability plugin component.
- [Struct Otlp Section Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-otlpsectionconfig.md): Shared OTLP exporter config for OpenTelemetry and OpenInference.
- [Struct S3Storage Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/struct-s3storageconfig.md): S3-compatible storage settings for ATIF trajectory upload.
- [Enum Atif Storage Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/enum-atifstorageconfig.md): Remote storage destination for ATIF trajectory files.
- [Constant OBSERVABILITY_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/constant-observability-plugin-kind.md): The plugin kind registered by the core crate.
- [Function deregister_observability_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/fn-deregister-observability-component.md): Deregisters the observability component kind from the core plugin registry.
- [Function register_observability_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/observability/plugin_component/fn-register-observability-component.md): Registers the observability component kind in the core plugin registry.
- [Module plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin.md): Generic plugin infrastructure for NeMo Relay runtimes.
- [Module dynamic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic.md): Dynamic plugin control-plane and registry model.
- [Struct Dynamic Plugin Failure](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginfailure.md): One structured recent failure summary.
- [Struct Dynamic Plugin Manifest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifest.md): Authored `relay-plugin.toml` manifest.
- [Struct Dynamic Plugin Manifest Capabilities](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestcapabilities.md): Capability declarations for authored manifests.
- [Struct Dynamic Plugin Manifest Compat](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestcompat.md): Compatibility block for `relay-plugin.toml`.
- [Struct Dynamic Plugin Manifest Config Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestconfigschema.md): Static configuration schema block for authored manifests.
- [Struct Dynamic Plugin Manifest Defaults](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestdefaults.md): Defaults block for authored manifests.
- [Struct Dynamic Plugin Manifest Integrity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestintegrity.md): Integrity/authenticity evidence block for authored manifests.
- [Struct Dynamic Plugin Manifest Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestplugin.md): Plugin identity block for `relay-plugin.toml`.
- [Struct Dynamic Plugin Manifest Rust Dynamic Load](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestrustdynamicload.md): Native shared-library authored load block.
- [Struct Dynamic Plugin Manifest Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestsource.md): Source block for authored manifests.
- [Struct Dynamic Plugin Manifest Worker Load](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmanifestworkerload.md): Worker lane authored load block.
- [Struct Dynamic Plugin Metadata](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginmetadata.md): Stable metadata for one durable plugin record.
- [Struct Dynamic Plugin Record](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginrecord.md): Durable control-plane record for a dynamic plugin.
- [Struct Dynamic Plugin Registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginregistry.md): In-memory dynamic plugin registry used by the control plane.
- [Struct Dynamic Plugin Runtime Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginruntimestatus.md): Observed runtime state for one plugin record.
- [Struct Dynamic Plugin Rust Compatibility](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginrustcompatibility.md): Compatibility contract for native shared libraries.
- [Struct Dynamic Plugin Rust Load Contract](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginrustloadcontract.md): Lane-specific load contract for native shared libraries.
- [Struct Dynamic Plugin Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginsource.md): Source and resolved artifact facts for a plugin.
- [Struct Dynamic Plugin Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginspec.md): Desired-state fields owned by user-facing operations.
- [Struct Dynamic Plugin Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginstatus.md): Durable observed state for a plugin record.
- [Struct Dynamic Plugin Validation Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginvalidationstatus.md): Decomposed validation results for one plugin record.
- [Struct Dynamic Plugin Worker Compatibility](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginworkercompatibility.md): Compatibility contract for worker plugins.
- [Struct Dynamic Plugin Worker Load Contract](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-dynamicpluginworkerloadcontract.md): Lane-specific load contract for worker plugins.
- [Struct Native Plugin Activation](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-nativepluginactivation.md): Owns native dynamic libraries registered into the plugin registry.
- [Struct Native Plugin Load Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/struct-nativepluginloadspec.md): Native plugin load request derived from host dynamic-plugin state.
- [Enum Dynamic Plugin Attestation Mode](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginattestationmode.md): Host attestation policy mode.
- [Enum Dynamic Plugin Capability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicplugincapability.md): Relay-enforced capability declared by a dynamic plugin.
- [Enum Dynamic Plugin Check State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicplugincheckstate.md): High-level verification state for one validation axis.
- [Enum Dynamic Plugin Compatibility](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicplugincompatibility.md): Lane-specific compatibility declarations and resolved compatibility facts.
- [Enum Dynamic Plugin Failure Phase](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginfailurephase.md): Recent failure phase for diagnostics and operator UX.
- [Enum Dynamic Plugin Kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginkind.md): Plugin execution lane.
- [Enum Dynamic Plugin Load Contract](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginloadcontract.md): Runtime entry contract for the resolved plugin.
- [Enum Dynamic Plugin Manifest Load](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginmanifestload.md): Load block for authored manifests.
- [Enum Dynamic Plugin Runtime State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginruntimestate.md): Observed runtime state for a dynamic plugin.
- [Enum Dynamic Plugin Startup Class](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-dynamicpluginstartupclass.md): Host policy startup classification for a plugin.
- [Enum Worker Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/enum-workerruntime.md): Managed runtime identity for worker-based plugins.
- [Constant DYNAMIC_PLUGIN_MANIFEST_FILENAME](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/constant-dynamic-plugin-manifest-filename.md): Canonical filename for authored Relay plugin manifests.
- [Function load_native_plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/fn-load-native-plugins.md): Loads native dynamic plugins and registers their plugin kinds.
- [Type Alias Dynamic Plugin Id](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/dynamic/type-dynamicpluginid.md): Canonical identifier for one dynamic plugin record.
- [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-configdiagnostic.md): Structured validation diagnostic for plugin validation.
- [Struct Config Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-configpolicy.md): Policy for how unsupported plugin/runtime config is handled.
- [Struct Config Report](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-configreport.md): Structured validation report.
- [Struct Plugin Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-plugincomponentspec.md): One configured plugin component.
- [Struct Plugin Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-pluginconfig.md): Canonical plugin configuration document.
- [Struct Plugin Registration](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-pluginregistration.md): Bookkeeping for one middleware/subscriber registration.
- [Struct Plugin Registration Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/struct-pluginregistrationcontext.md): Context provided to plugin handlers during runtime registration.
- [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/enum-diagnosticlevel.md): Diagnostic severity returned by plugin validation.
- [Enum Plugin Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/enum-pluginerror.md): Error type for generic plugin operations.
- [Enum Unsupported Behavior](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/enum-unsupportedbehavior.md): Per-policy behavior for unsupported configuration.
- [Trait Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/trait-plugin.md): Implemented by custom plugins that register runtime middleware.
- [Function active_plugin_report](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-active-plugin-report.md): Returns the last successfully configured plugin report.
- [Function clear_plugin_configuration](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-clear-plugin-configuration.md): Deregisters and clears all configured plugin components.
- [Function deregister_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-deregister-plugin.md): Removes a previously registered plugin.
- [Function ensure_builtin_plugins_registered](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-ensure-builtin-plugins-registered.md): Registers core-provided plugin kinds.
- [Function initialize_plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-initialize-plugins.md): Validates and activates `config` layered on top of the discovered `plugins.toml` configuration, so a direct integration sees the same file layering as the gateway. `config` wins on conflicts; as a typed document its default `version`/`policy`/`enabled` override the file, while `config` bodies merge field-by-field. Delegates to `initialize_plugins_exact`.
- [Function list_plugin_kinds](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-list-plugin-kinds.md): Lists registered plugin kinds in sorted order.
- [Function lookup_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-lookup-plugin.md): Looks up a registered plugin by kind.
- [Function register_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-register-plugin.md): Registers a plugin by kind.
- [Function rollback_registrations](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-rollback-registrations.md): Rolls back registrations in reverse order, ignoring rollback failures.
- [Function validate_plugin_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/fn-validate-plugin-config.md): Validates a plugin configuration document.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugin/type-result.md): Specialized `Result` type for plugin operations.
- [Module plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins.md): First-party plugin implementations for NeMo Relay Core.
- [Module model_pricing](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/model_pricing.md): Built-in model pricing plugin component module.
- [Constant PRICING_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/model_pricing/constant-pricing-plugin-kind.md): Plugin kind used by the model pricing component.
- [Function register_pricing_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/model_pricing/fn-register-pricing-component.md): Registers the built-in model pricing component.
- [Module nemo_guardrails](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails.md): Planned NeMo Guardrails plugin integrations for NeMo Relay Core.
- [Module component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component.md): NeMo Guardrails plugin component contract.
- [Struct Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-componentspec.md): Top-level NeMo Guardrails component wrapper.
- [Struct Local Backend Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-localbackendconfig.md): Local-backend settings for the Python `nemoguardrails` runtime.
- [Struct NeMo Guardrails Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-nemoguardrailsconfig.md): Canonical config document for the planned NeMo Guardrails component.
- [Struct Remote Backend Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-remotebackendconfig.md): Remote-backend settings for a hosted NeMo Guardrails service.
- [Struct Request Defaults Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-requestdefaultsconfig.md): Default request semantics applied by the selected Guardrails backend.
- [Struct Request Rails Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/struct-requestrailsconfig.md): Request-time rail selection for Guardrails generation.
- [Enum Rail Selector](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/enum-railselector.md): Rail-selection shape used by Guardrails generation options.
- [Constant NEMO_GUARDRAILS_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/constant-nemo-guardrails-plugin-kind.md): The plugin kind reserved for the planned first-party component.
- [Function deregister_nemo_guardrails_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/fn-deregister-nemo-guardrails-component.md): Deregisters the `nemo_guardrails` component kind from the plugin registry.
- [Function register_nemo_guardrails_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/plugins/nemo_guardrails/component/fn-register-nemo-guardrails-component.md): Registers the `nemo_guardrails` component kind in the plugin registry.
- [Module stream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/stream.md): Streaming LLM response wrapper.
- [Struct LlmStream Wrapper](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/stream/struct-llmstreamwrapper.md): Wraps an inner `Stream<Item = Result<Json>>` of raw chunks and:
- [Macro editor_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay/macro-editor-config.md): Implements `EditorConfig` for a configuration type.
- [nemo-relay-adaptive](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive.md): NeMo Relay Adaptive
- [Module acg](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg.md): Canonical Adaptive Cache Governor (ACG) module surface exposed from the adaptive crate.
- [Module anthropic_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/anthropic_plugin.md): Anthropic cache plugin for the Adaptive Cache Governor (ACG) system.
- [Struct Anthropic Cache Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/anthropic_plugin/struct-anthropiccacheplugin.md): Anthropic-specific provider plugin for cache_control breakpoint injection.
- [Module canonicalize](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/canonicalize.md): RFC 8785 JSON Canonicalization and whitespace normalization for cache stability.
- [Function canonicalize_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/canonicalize/fn-canonicalize-json.md): Canonicalize a JSON string per RFC 8785 (JCS).
- [Function canonicalize_value](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/canonicalize/fn-canonicalize-value.md): Canonicalize a `serde_json::Value` per RFC 8785.
- [Function normalize_whitespace](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/canonicalize/fn-normalize-whitespace.md): Normalize whitespace in text content.
- [Function sha256_hex](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/canonicalize/fn-sha256-hex.md): Compute SHA-256 hex digest with `"sha256:"` prefix.
- [Module capability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/capability.md): Capability registry tracking per-backend and per-model-family supported features.
- [Struct Backend Capabilities](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/capability/struct-backendcapabilities.md): Capabilities of a specific backend provider.
- [Struct Cache Economics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/capability/struct-cacheeconomics.md): Provider/model-specific cache economics used by the internal planner.
- [Struct Capability Registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/capability/struct-capabilityregistry.md): Registry holding capabilities for all known backends.
- [Struct Model Family Capabilities](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/capability/struct-modelfamilycapabilities.md): Per-model-family capability overrides within a backend.
- [Enum Provider Feature](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/capability/enum-providerfeature.md): Feature that a backend or model family may support.
- [Module ir_builder](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/ir_builder.md): AnnotatedLlmRequest to PromptIR construction pipeline.
- [Function build_prompt_ir](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/ir_builder/fn-build-prompt-ir.md): Build a normalized `PromptIR` from an annotated LLM request.
- [Module openai_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/openai_plugin.md): OpenAI cache plugin for the Adaptive Cache Governor (ACG) system.
- [Struct OpenAI Cache Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/openai_plugin/struct-openaicacheplugin.md): OpenAI-specific provider plugin for deterministic JSON serialization.
- [Module passthrough](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/passthrough.md): Passthrough plugin that applies no transformations.
- [Struct Passthrough Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/passthrough/struct-passthroughplugin.md): A no-op provider plugin that passes requests through unchanged.
- [Module plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/plugin.md): Provider plugin trait and input/output types for the Adaptive Cache Governor (ACG) system.
- [Struct Plugin Input](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/plugin/struct-plugininput.md): Input data provided to a plugin for translation.
- [Struct Plugin Output](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/plugin/struct-pluginoutput.md): Output produced by a plugin after translation.
- [Trait Provider Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/plugin/trait-providerplugin.md): Provider plugin trait for backend-specific translation.
- [Module plugin_registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/plugin_registry.md): Plugin registry for storing and retrieving provider plugins.
- [Struct Plugin Registry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/plugin_registry/struct-pluginregistry.md): Registry for storing and retrieving provider plugins.
- [Module policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy.md): Policy types for the Adaptive Cache Governor (ACG) system.
- [Struct Archetype Routing Override](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-archetyperoutingoverride.md): Routing override for one observed session archetype.
- [Struct Cache Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-cachepolicy.md): Policy controlling when ACG outputs can be cached and reused.
- [Struct Policy Envelope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-policyenvelope.md): Versioned wrapper for an ACG policy document.
- [Struct Retention Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-retentionpolicy.md): Policy controlling how long learned artifacts should be retained.
- [Struct Rewrite Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-rewritepolicy.md): Policy controlling what prompt rewrites the runtime can apply automatically.
- [Struct Routing Policy](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-routingpolicy.md): Policy controlling model-class routing decisions.
- [Struct Scope Retention Override](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/struct-scoperetentionoverride.md): Retention-tier override for one sharing scope.
- [Enum Transformation Class](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/policy/enum-transformationclass.md): Rewrite category that an ACG policy can allow or deny.
- [Module profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile.md): Behavioral profile types for the Adaptive Cache Governor (ACG) system.
- [Struct Behavioral Profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/struct-behavioralprofile.md): Aggregated behavioral profile derived from observed runs.
- [Struct Block Stability Score](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/struct-blockstabilityscore.md): Stability analysis result for one prompt block.
- [Struct Distribution Summary](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/struct-distributionsummary.md): Percentile summary for a duration-like metric.
- [Struct Parallelism Pattern](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/struct-parallelismpattern.md): Summary of observed parallelism behavior across runs.
- [Struct Tool Usage Phase](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/struct-toolusagephase.md): One phase of tool usage observed in an agent workflow.
- [Enum Session Archetype](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/enum-sessionarchetype.md): Coarse behavioral archetype inferred from observed runs.
- [Enum Stability Class](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/profile/enum-stabilityclass.md): Stability bucket assigned to a prompt block.
- [Module prompt_ir](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir.md): Prompt Intermediate Representation (IR) types for the Adaptive Cache Governor (ACG) system.
- [Struct Prompt Block](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/struct-promptblock.md): A single addressable block within the Prompt IR.
- [Struct PromptIR](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/struct-promptir.md): Prompt Intermediate Representation - the full decomposed prompt.
- [Struct SpanId](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/struct-spanid.md): Stable span identifier for addressable prompt blocks.
- [Struct Tokenization Metadata](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/struct-tokenizationmetadata.md): Token count metadata for a prompt block.
- [Struct Tool Schema Hash](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/struct-toolschemahash.md): Hash fingerprint of a tool schema definition.
- [Enum Block Content Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/enum-blockcontenttype.md): Content type discriminant for a prompt block.
- [Enum Prompt Role](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/enum-promptrole.md): Role of a prompt block within the conversation.
- [Enum Provenance Label](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/enum-provenancelabel.md): Origin label for a prompt block.
- [Enum Sensitivity Label](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/prompt_ir/enum-sensitivitylabel.md): Sensitivity classification for a prompt block.
- [Module retention](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/retention.md): Retention intent generation from observed session timing distributions.
- [Struct Retention Thresholds](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/retention/struct-retentionthresholds.md): Thresholds used to map observed timing into a retention tier.
- [Function generate_retention_intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/retention/fn-generate-retention-intent.md): Generate a retention intent from observed session timing distributions.
- [Function generate_retention_intent_default](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/retention/fn-generate-retention-intent-default.md): Generate a retention intent with the default thresholds.
- [Module stability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/stability.md): Stability analysis for prompt blocks across multiple observations.
- [Struct Stability Analysis Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/stability/struct-stabilityanalysisresult.md): Result of analyzing prompt stability across a set of observations.
- [Struct Stability Thresholds](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/stability/struct-stabilitythresholds.md): Thresholds controlling prompt-block stability classification.
- [Function analyze_stability](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/stability/fn-analyze-stability.md): Analyze prompt-block stability across multiple observations.
- [Function find_stable_prefix_length](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/stability/fn-find-stable-prefix-length.md): Count the number of leading scores classified as stable.
- [Module telemetry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry.md): Cache performance telemetry types for the Adaptive Cache Governor (ACG) system.
- [Struct Cache HitRate](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/struct-cachehitrate.md): Aggregated cache hit rate over a time window.
- [Struct Cache Miss Diagnosis](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/struct-cachemissdiagnosis.md): Structured diagnosis for a cache miss.
- [Struct Cache Request Facts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/struct-cacherequestfacts.md): Request-time facts used to classify a cache miss without leaking prompt text.
- [Struct Cache Telemetry Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/struct-cachetelemetryevent.md): Per-call cache telemetry event.
- [Enum Cache Miss Evidence](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/enum-cachemissevidence.md): Typed evidence for a cache miss diagnosis.
- [Enum Cache Miss Reason](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/enum-cachemissreason.md): Reason why a cache miss occurred.
- [Enum Cache Telemetry Provider](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/telemetry/enum-cachetelemetryprovider.md): Cache telemetry provider identity for canonical `Usage` normalization.
- [Module types](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types.md): Core data types for the Adaptive Cache Governor (ACG) crate.
- [Struct Agent Identity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-agentidentity.md): Identity model for an agent type.
- [Struct Cache Stability Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-cachestabilityintent.md): Cache stability analysis results for a prompt region.
- [Struct Compression Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-compressionintent.md): Content compression intent.
- [Struct Content Extraction Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-contentextractionintent.md): Content extraction intent for variable content detection.
- [Struct Intent Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-intentoutcome.md): Records the outcome of translating a single optimization intent.
- [Struct Model Routing Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-modelroutingintent.md): Model routing and selection intent.
- [Struct Optimization Intent Bundle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-optimizationintentbundle.md): A bundle of optimization intents for a single request.
- [Struct Placement Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-placementintent.md): Context placement optimization intent.
- [Struct Priority Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-priorityintent.md): Latency and priority routing intent.
- [Struct Retention Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-retentionintent.md): Cache retention policy intent.
- [Struct Serialization Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-serializationintent.md): Serialization and fanout optimization intent.
- [Struct Tool Scope Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-toolscopeintent.md): Tool scope and phase management intent.
- [Struct Translation Report](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/struct-translationreport.md): A plugin's complete report on how it handled an intent bundle.
- [Enum Intent Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-intenttype.md): Discriminant enum for intent types (used in translation report outcomes).
- [Enum Model Class](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-modelclass.md): Model complexity/criticality class for routing.
- [Enum Optimization Intent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-optimizationintent.md): A single optimization intent emitted by a behavioral model.
- [Enum Placement Target](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-placementtarget.md): Target location for context placement.
- [Enum Reason Code](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-reasoncode.md): Machine-readable reason for the translation outcome.
- [Enum Retention Tier](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-retentiontier.md): Retention tier for cached state.
- [Enum Sharing Scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-sharingscope.md): Sharing scope for cached content - stability does not imply shareability. Default is `Session` per security requirements.
- [Enum Translation Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/types/enum-translationstatus.md): Outcome status for a single intent translation.
- [Module variable_extractor](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor.md): Variable content detection and extraction from prompt blocks.
- [Struct Extracted Variable](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/struct-extractedvariable.md): One extracted variable occurrence within a prompt block.
- [Struct Extraction Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/struct-extractionresult.md): Variable extraction result for one prompt block.
- [Struct Variable Pattern](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/struct-variablepattern.md): Regex-based pattern used to detect variable content.
- [Enum Variable Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/enum-variablecategory.md): Category assigned to an extracted variable.
- [Function default_variable_patterns](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/fn-default-variable-patterns.md): Return the default regex patterns used for variable extraction.
- [Function extract_variables](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/fn-extract-variables.md): Extract variables from one content string.
- [Function extract_variables_from_blocks](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/variable_extractor/fn-extract-variables-from-blocks.md): Extract variables from a set of prompt blocks.
- [Module error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/error.md): Error types for the Adaptive Cache Governor (ACG) crate.
- [Enum AcgError](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/error/enum-acgerror.md): The error type for all Adaptive Cache Governor (ACG) operations.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/error/type-result.md): A specialized `Result` type for ACG operations.
- [Constant MIN_ACG_OBSERVATIONS](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg/constant-min-acg-observations.md): Minimum observations required before Adaptive Cache Governor (ACG) emits optimization intents.
- [Module acg_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg_component.md): Adaptive Cache Governor (ACG) request and execution intercept helpers for the adaptive runtime.
- [Module acg_learner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg_learner.md): Adaptive Cache Governor (ACG) learner for the adaptive telemetry pipeline.
- [Struct AcgLearner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg_learner/struct-acglearner.md): Learner that derives prompt stability state for ACG.
- [Module acg_profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/acg_profile.md): Derives stable Adaptive Cache Governor (ACG) profile keys from structured LLM requests.
- [Module adaptive_hints_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/adaptive_hints_intercept.md): AdaptiveHintsIntercept: opt-in LLM request intercept that injects AgentHints from HotCache trie.
- [Struct Adaptive Hints Intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/adaptive_hints_intercept/struct-adaptivehintsintercept.md): Opt-in LLM request intercept that injects `AgentHints` into request headers from the prediction trie in `HotCache`.
- [Module cache_diagnostics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/cache_diagnostics.md): Runtime-local cache miss request facts and diagnostics tracking.
- [Struct Cache Diagnostics Tracker](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/cache_diagnostics/struct-cachediagnosticstracker.md): Runtime-local miss diagnosis tracker.
- [Function build_cache_request_facts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/cache_diagnostics/fn-build-cache-request-facts.md): Builds canonical request facts for cache miss diagnosis from the live runtime state.
- [Module config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config.md): Canonical adaptive config and diagnostics types.
- [Struct AcgComponent Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-acgcomponentconfig.md): Typed helper for the built-in Adaptive Cache Governor (ACG) component.
- [Struct Adaptive Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-adaptiveconfig.md): Canonical config document for the adaptive plugin component.
- [Struct Adaptive Hints Component Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-adaptivehintscomponentconfig.md): Typed helper for adaptive hints settings.
- [Struct Backend Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-backendspec.md): Dynamic backend selection. `config` is backend-specific.
- [Struct State Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-stateconfig.md): Shared state configuration consumed by adaptive features that need persistence.
- [Struct Telemetry Component Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-telemetrycomponentconfig.md): Typed helper for telemetry settings.
- [Struct Tool Parallelism Component Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-toolparallelismcomponentconfig.md): Typed helper for tool parallelism settings.
- [Module context_helpers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers.md): Context helpers for reading scope metadata on the intercept hot path.
- [Struct Shared Parent Scope Identity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/struct-sharedparentscopeidentity.md): Session-local scope identity used to coordinate warm-first cohorts.
- [Constant LATENCY_SENSITIVITY_POINTER](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/constant-latency-sensitivity-pointer.md): Metadata key path for manual latency sensitivity annotation.
- [Function extract_scope_path](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/fn-extract-scope-path.md): Extracts the current function call path from the NeMo Relay scope stack.
- [Function read_manual_latency_sensitivity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/fn-read-manual-latency-sensitivity.md): Reads the maximum manual latency sensitivity from all scopes in the current scope stack.
- [Function resolve_agent_id](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/fn-resolve-agent-id.md): Resolves the agent ID from the current scope stack.
- [Function resolve_shared_parent_scope_identity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/fn-resolve-shared-parent-scope-identity.md): Resolves the session-local identity used by warm-first cohort coordination.
- [Function set_latency_sensitivity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/context_helpers/fn-set-latency-sensitivity.md): Sets latency sensitivity on the current (top) scope using max-merge semantics.
- [Module drain](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/drain.md): Background drain task for async telemetry processing.
- [Module error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/error.md): Error types for the nemo-relay-adaptive crate.
- [Enum Adaptive Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/error/enum-adaptiveerror.md): The error type for all nemo-relay-adaptive operations.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/error/type-result.md): A specialized `Result` type for nemo-relay-adaptive operations.
- [Module intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/intercepts.md): Intercept factories for the `nemo-relay-adaptive` crate, including Adaptive Cache Governor (ACG) intercepts.
- [Constant AGENT_HINTS_HEADER_KEY](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/intercepts/constant-agent-hints-header-key.md): Header key used to propagate serialized adaptive agent hints.
- [Module learner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/learner.md): Learning primitives and built-in learner implementations. Adaptive learners that derive runtime hints from observed executions.
- [Module latency](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/learner/latency.md): Learner that builds latency sensitivity hints from run history. Latency-sensitivity learner implementation.
- [Struct Latency Sensitivity Learner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/learner/latency/struct-latencysensitivitylearner.md): Learner that derives default latency sensitivity hints from run history.
- [Function compute_default_hints](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/learner/latency/fn-compute-default-hints.md): Compute default agent hints from the root trie prediction.
- [Module traits](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/learner/traits.md): Common learner trait implemented by adaptive background processors. Shared learner traits for adaptive background processing.
- [Trait Learner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/learner/traits/trait-learner.md): Background learner that updates adaptive state from observed runs.
- [Module plugin_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/plugin_component.md): Core plugin integration for the adaptive runtime.
- [Struct Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/plugin_component/struct-componentspec.md): One configured adaptive component.
- [Constant ADAPTIVE_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/plugin_component/constant-adaptive-plugin-kind.md): The plugin kind registered by the adaptive crate.
- [Function deregister_adaptive_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/plugin_component/fn-deregister-adaptive-component.md): Deregisters the adaptive component kind from the core plugin registry.
- [Function register_adaptive_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/plugin_component/fn-register-adaptive-component.md): Registers the adaptive component kind in the core plugin registry.
- [Module redis](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/redis.md): Redis-backed `StorageBackend` implementation.
- [Struct Redis Backend](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/redis/struct-redisbackend.md): A Redis-backed storage backend for cross-process shared state.
- [Module storage](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage.md): Storage backends and backend traits for adaptive state persistence. Storage backends for adaptive runtime state and learned artifacts.
- [Module erased](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/erased.md): Erased backend alias used by runtime configuration and dependency injection. Type-erased storage backend aliases.
- [Type Alias AnyBackend](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/erased/type-anybackend.md): Type-erased adaptive storage backend.
- [Module memory](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/memory.md): In-memory backend useful for tests and local-only runtime state. In-memory adaptive storage backend.
- [Struct InMemory Backend](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/memory/struct-inmemorybackend.md): In-memory backend storing adaptive state in process-local hash maps.
- [Module traits](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/traits.md): Async storage traits implemented by adaptive persistence backends. Storage traits used by adaptive backends.
- [Trait Storage Backend](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/traits/trait-storagebackend.md): Minimal async storage interface required by the adaptive runtime.
- [Trait Storage Backend Dyn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/storage/traits/trait-storagebackenddyn.md): Object-safe storage interface used by the adaptive runtime.
- [Module subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/subscriber.md): Event subscriber factory and event-to-record mapping helpers.
- [Module tool_parallelism_learner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/tool_parallelism_learner.md): Learner that derives tool fan-out plans from observed runs. Learner that derives tool parallelism plans from observed runs.
- [Struct Tool Parallelism Learner](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/tool_parallelism_learner/struct-toolparallelismlearner.md): Learner that discovers tool fan-out groups from run telemetry.
- [Module trie](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie.md): Prediction trie data structures for the online learning engine.
- [Module accumulator](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/accumulator.md): Streaming statistics accumulator using Welford's algorithm and TDigest.
- [Struct Accumulator State](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/accumulator/struct-accumulatorstate.md): Maps trie path strings to their node accumulators.
- [Struct Node Accumulators](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/accumulator/struct-nodeaccumulators.md): Per-node accumulators for all metric types, keyed by call index.
- [Struct Running Stats](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/accumulator/struct-runningstats.md): Streaming statistics tracker combining Welford's online algorithm for mean/variance with a TDigest for streaming percentile estimation.
- [Module builder](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/builder.md): Prediction trie builder with incremental accumulator merge.
- [Struct Prediction Trie Builder](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/builder/struct-predictiontriebuilder.md): Builds a `PredictionTrieNode` tree from `RunRecord`s via incremental accumulator merge.
- [Struct Sensitivity Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/builder/struct-sensitivityconfig.md): Configuration for auto-sensitivity scoring.
- [Module data_models](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/data_models.md): Core prediction trie data types with NAT wire-format compatible serialization.
- [Struct LlmCall Prediction](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/data_models/struct-llmcallprediction.md): Predictions for an LLM call at a given position in the call hierarchy.
- [Struct Prediction Metrics](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/data_models/struct-predictionmetrics.md): Aggregated statistics for a single metric from profiler data.
- [Struct Prediction Trie Node](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/data_models/struct-predictiontrienode.md): A node in the prediction trie representing a function in the call hierarchy.
- [Module lookup](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/lookup.md): Prediction trie lookup with three-level fallback chain.
- [Struct Prediction Trie Lookup](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/lookup/struct-predictiontrielookup.md): Looks up predictions in a prediction trie with graceful fallback.
- [Module serialization](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/serialization.md): NAT wire-format serialization for prediction tries.
- [Struct Trie Envelope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/serialization/struct-trieenvelope.md): Versioned envelope wrapping a prediction trie for JSON persistence.
- [Constant CURRENT_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/trie/serialization/constant-current-version.md): Version string for the trie wire format.
- [Module types](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types.md): Serializable adaptive data models shared across runtime components. Serializable adaptive runtime data models.
- [Module cache](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/cache.md): Hot-cache structures used by the adaptive runtime on the intercept path. Hot-cache state shared by adaptive runtime features.
- [Struct HotCache](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/cache/struct-hotcache.md): In-memory cache of adaptive artifacts needed on the hot path.
- [Module metadata](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/metadata.md): Metadata and hint payloads attached to adaptive execution plans. Metadata and hint payload types used by adaptive planning.
- [Struct Agent Hints](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/metadata/struct-agenthints.md): Runtime hint bundle exposed to downstream integrations.
- [Struct Metadata Envelope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/metadata/struct-metadataenvelope.md): Metadata template attached to an adaptive execution plan.
- [Struct Parallel Hint](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/metadata/struct-parallelhint.md): Hint describing one tool's membership in a parallel-execution cohort.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/metadata/type-json.md): JSON value alias used by adaptive metadata payloads.
- [Module plan](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/plan.md): Execution-plan types describing discovered tool parallelism. Adaptive execution-plan data models.
- [Struct Execution Plan](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/plan/struct-executionplan.md): Learned execution plan for an agent.
- [Struct Parallel Group](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/plan/struct-parallelgroup.md): Group of tools that have been observed to run in parallel.
- [Module records](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/records.md): Run and call record types collected by the telemetry pipeline. Run and call record types collected by the adaptive telemetry pipeline.
- [Struct Call Record](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/records/struct-callrecord.md): Telemetry record for a single tool or LLM call.
- [Struct RunRecord](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/records/struct-runrecord.md): Telemetry record for one observed agent run.
- [Enum Call Kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/types/records/enum-callkind.md): Kind of runtime call captured in adaptive telemetry.
- [Struct Adaptive Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-adaptive/struct-adaptiveruntime.md): Hosted adaptive runtime that registers NeMo Relay plugin components.
- [nemo-relay-pii-redaction](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction.md): First-party PII redaction plugin crate for NeMo Relay.
- [Module component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component.md): PII redaction plugin component contract.
- [Struct Builtin Backend Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/struct-builtinbackendconfig.md): Built-in redaction backend settings.
- [Struct Component Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/struct-componentspec.md): Top-level PII redaction component wrapper.
- [Struct Local Backend Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/struct-localbackendconfig.md): Local-backend settings for a future in-process local-model runtime.
- [Struct PiiRedaction Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/struct-piiredactionconfig.md): Canonical config document for the PII redaction component.
- [Constant PII_REDACTION_PLUGIN_KIND](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/constant-pii-redaction-plugin-kind.md): The plugin kind reserved for the built-in privacy component.
- [Function deregister_pii_redaction_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/fn-deregister-pii-redaction-component.md): Deregisters the `pii_redaction` component kind from the plugin registry.
- [Function register_pii_redaction_component](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-pii-redaction/component/fn-register-pii-redaction-component.md): Registers the `pii_redaction` component kind in the plugin registry.
- [nemo-relay-ffi](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi.md): C FFI layer for NeMo Relay.
- [Module api](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api.md): Top-level FFI API functions exported as `extern "C"`.
- [Struct FfiStream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/struct-ffistream.md): Opaque stream handle for consuming LLM streaming responses chunk by chunk. Use `nemo_relay_stream_next` to poll and `nemo_relay_stream_free` to release.
- [Function nemo_relay_active_plugin_report_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-active-plugin-report-json.md): Return the last successfully configured plugin report as JSON.
- [Function nemo_relay_adaptive_build_cache_telemetry_event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-build-cache-telemetry-event.md): Build one cache telemetry event as JSON.
- [Function nemo_relay_adaptive_runtime_bind_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-bind-scope.md): Bind ACG request rewrites to a scope.
- [Function nemo_relay_adaptive_runtime_build_cache_request_facts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-build-cache-request-facts.md): Build cache request facts as JSON.
- [Function nemo_relay_adaptive_runtime_create](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-create.md): Create an owned adaptive runtime handle from config JSON.
- [Function nemo_relay_adaptive_runtime_deregister](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-deregister.md): Deregister configured adaptive runtime features.
- [Function nemo_relay_adaptive_runtime_register](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-register.md): Register configured adaptive runtime features.
- [Function nemo_relay_adaptive_runtime_report_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-report-json.md): Return the runtime construction report as JSON.
- [Function nemo_relay_adaptive_runtime_shutdown](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-shutdown.md): Shut down the adaptive runtime and consume its Rust runtime state.
- [Function nemo_relay_adaptive_runtime_wait_for_idle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-runtime-wait-for-idle.md): Wait until the adaptive telemetry drain has processed pending events.
- [Function nemo_relay_adaptive_set_latency_sensitivity](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-set-latency-sensitivity.md): Set manual latency sensitivity on the current scope.
- [Function nemo_relay_adaptive_validate_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-adaptive-validate-config.md): Validate an adaptive config document and return the diagnostics report as JSON.
- [Function nemo_relay_anthropic_messages_codec_new](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-anthropic-messages-codec-new.md): Create a new Anthropic Messages API codec handle.
- [Function nemo_relay_atif_exporter_clear](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atif-exporter-clear.md): Clears all collected events from the exporter.
- [Function nemo_relay_atif_exporter_create](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atif-exporter-create.md): Creates a new ATIF exporter.
- [Function nemo_relay_atif_exporter_deregister](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atif-exporter-deregister.md): Deregisters the exporter subscriber.
- [Function nemo_relay_atif_exporter_export](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atif-exporter-export.md): Exports collected events as an ATIF trajectory JSON string.
- [Function nemo_relay_atif_exporter_register](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atif-exporter-register.md): Registers the exporter as an event subscriber.
- [Function nemo_relay_atof_exporter_create](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-create.md): Creates a new filesystem-backed ATOF JSONL exporter.
- [Function nemo_relay_atof_exporter_create_from_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-create-from-json.md): Creates a new ATOF exporter from a JSON config object.
- [Function nemo_relay_atof_exporter_deregister](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-deregister.md): Deregisters the ATOF exporter subscriber.
- [Function nemo_relay_atof_exporter_force_flush](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-force-flush.md): Flushes the ATOF exporter output file.
- [Function nemo_relay_atof_exporter_path](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-path.md): Returns the ATOF exporter output path as a string.
- [Function nemo_relay_atof_exporter_register](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-register.md): Registers the ATOF exporter as an event subscriber.
- [Function nemo_relay_atof_exporter_shutdown](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-atof-exporter-shutdown.md): Shuts down the ATOF exporter by flushing output.
- [Function nemo_relay_clear_plugin_configuration](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-clear-plugin-configuration.md): Clear the active global plugin configuration.
- [Function nemo_relay_deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-llm-conditional-execution-guardrail.md): Deregister an LLM conditional execution guardrail by name.
- [Function nemo_relay_deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-llm-execution-intercept.md): Deregister an LLM execution intercept by name.
- [Function nemo_relay_deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-llm-request-intercept.md): Deregister an LLM request intercept by name.
- [Function nemo_relay_deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-llm-sanitize-request-guardrail.md): Deregister an LLM request sanitization guardrail by name.
- [Function nemo_relay_deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-llm-sanitize-response-guardrail.md): Deregister an LLM response sanitization guardrail by name.
- [Function nemo_relay_deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-llm-stream-execution-intercept.md): Deregister an LLM streaming execution intercept by name.
- [Function nemo_relay_deregister_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-plugin.md): Deregister a plugin by kind.
- [Function nemo_relay_deregister_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-subscriber.md): Deregister an event subscriber by name.
- [Function nemo_relay_deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-tool-conditional-execution-guardrail.md): Deregister a tool conditional execution guardrail by name.
- [Function nemo_relay_deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-tool-execution-intercept.md): Deregister a tool execution intercept by name.
- [Function nemo_relay_deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-tool-request-intercept.md): Deregister a tool request intercept by name.
- [Function nemo_relay_deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-tool-sanitize-request-guardrail.md): Deregister a tool request sanitization guardrail by name.
- [Function nemo_relay_deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-deregister-tool-sanitize-response-guardrail.md): Deregister a tool response sanitization guardrail by name.
- [Function nemo_relay_event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-event.md): Emit a named lifecycle event.
- [Function nemo_relay_flush_subscribers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-flush-subscribers.md): Wait for subscriber callbacks queued before this call to finish.
- [Function nemo_relay_get_handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-get-handle.md): Retrieve the current scope handle from the thread-local scope stack.
- [Function nemo_relay_initialize_plugins](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-initialize-plugins.md): Initialize the active global plugin components and return the resulting diagnostics report.
- [Function nemo_relay_list_plugin_kinds_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-list-plugin-kinds-json.md): Return the registered plugin kinds as JSON.
- [Function nemo_relay_llm_call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-call.md): Begin a manual LLM call lifecycle span.
- [Function nemo_relay_llm_call_end](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-call-end.md): End a manual LLM call lifecycle span.
- [Function nemo_relay_llm_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-call-execute.md): Execute an LLM call end-to-end: run conditional-execution guardrails (on raw request), then request intercepts, sanitize-request guardrails, execution intercepts, the callback, and sanitize-response guardrails. On rejection, only a standalone Mark event is emitted (no Start/End pair) and `GuardrailRejected` is returned. Blocks the calling thread until completion.
- [Function nemo_relay_llm_conditional_execution](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-conditional-execution.md): Run the registered LLM conditional execution guardrail chain.
- [Function nemo_relay_llm_request_intercept_outcome_json_new](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-request-intercept-outcome-json-new.md): Allocate canonical JSON for a C LLM request-intercept callback result.
- [Function nemo_relay_llm_request_intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-request-intercepts.md): Run the registered LLM request intercept chain on the given request.
- [Function nemo_relay_llm_stream_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-llm-stream-call-execute.md): Execute a streaming LLM call end-to-end. Conditional-execution guardrails run first on the raw request. Returns a stream handle that can be polled with `nemo_relay_stream_next`. Blocks until the stream is set up.
- [Function nemo_relay_observability_component_spec_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-observability-component-spec-json.md): Wrap an observability config JSON object as a top-level plugin component.
- [Function nemo_relay_observability_default_config_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-observability-default-config-json.md): Return the default observability plugin config as JSON.
- [Function nemo_relay_observability_plugin_kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-observability-plugin-kind.md): Return the built-in observability plugin kind.
- [Function nemo_relay_openai_chat_codec_new](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openai-chat-codec-new.md): Create a new OpenAI Chat Completions codec handle.
- [Function nemo_relay_openai_responses_codec_new](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openai-responses-codec-new.md): Create a new OpenAI Responses API codec handle.
- [Function nemo_relay_openinference_subscriber_create](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openinference-subscriber-create.md): Creates a new OpenInference subscriber.
- [Function nemo_relay_openinference_subscriber_deregister](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openinference-subscriber-deregister.md): Deregisters the OpenInference subscriber by name.
- [Function nemo_relay_openinference_subscriber_force_flush](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openinference-subscriber-force-flush.md): Forces a flush of finished spans through the exporter.
- [Function nemo_relay_openinference_subscriber_register](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openinference-subscriber-register.md): Registers the OpenInference subscriber as an event subscriber.
- [Function nemo_relay_openinference_subscriber_shutdown](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-openinference-subscriber-shutdown.md): Shuts down the underlying tracer provider.
- [Function nemo_relay_otel_subscriber_create](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-otel-subscriber-create.md): Creates a new OpenTelemetry subscriber.
- [Function nemo_relay_otel_subscriber_deregister](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-otel-subscriber-deregister.md): Deregisters the OpenTelemetry subscriber by name.
- [Function nemo_relay_otel_subscriber_force_flush](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-otel-subscriber-force-flush.md): Forces a flush of finished spans through the exporter.
- [Function nemo_relay_otel_subscriber_register](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-otel-subscriber-register.md): Registers the OpenTelemetry subscriber as an event subscriber.
- [Function nemo_relay_otel_subscriber_shutdown](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-otel-subscriber-shutdown.md): Shuts down the underlying tracer provider.
- [Function nemo_relay_plugin_context_register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-llm-conditional-execution-guardrail.md): Register an LLM conditional-execution guardrail into the plugin registration context.
- [Function nemo_relay_plugin_context_register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-llm-execution-intercept.md): Register an LLM execution intercept into the plugin registration context.
- [Function nemo_relay_plugin_context_register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-llm-request-intercept.md): Register an LLM request intercept into the plugin registration context.
- [Function nemo_relay_plugin_context_register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-llm-sanitize-request-guardrail.md): Register an LLM sanitize-request guardrail into the plugin registration context.
- [Function nemo_relay_plugin_context_register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-llm-sanitize-response-guardrail.md): Register an LLM sanitize-response guardrail into the plugin registration context.
- [Function nemo_relay_plugin_context_register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-llm-stream-execution-intercept.md): Register an LLM stream execution intercept into the plugin registration context.
- [Function nemo_relay_plugin_context_register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-subscriber.md): Register an event subscriber into the plugin registration context.
- [Function nemo_relay_plugin_context_register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-tool-conditional-execution-guardrail.md): Register a tool conditional-execution guardrail into the plugin registration context.
- [Function nemo_relay_plugin_context_register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-tool-execution-intercept.md): Register a tool execution intercept into the plugin registration context.
- [Function nemo_relay_plugin_context_register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-tool-request-intercept.md): Register a tool request intercept into the plugin registration context.
- [Function nemo_relay_plugin_context_register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-tool-sanitize-request-guardrail.md): Register a tool sanitize-request guardrail into the plugin registration context.
- [Function nemo_relay_plugin_context_register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-plugin-context-register-tool-sanitize-response-guardrail.md): Register a tool sanitize-response guardrail into the plugin registration context.
- [Function nemo_relay_pop_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-pop-scope.md): Pop a scope from the scope stack by its handle.
- [Function nemo_relay_push_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-push-scope.md): Push a new scope onto the scope stack.
- [Function nemo_relay_register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-llm-conditional-execution-guardrail.md): Register an LLM conditional execution guardrail. The callback decides whether an LLM call should proceed.
- [Function nemo_relay_register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-llm-execution-intercept.md): Register an LLM execution intercept following the middleware chain pattern. The callback receives `(request, next_fn, next_ctx)` - call `next_fn(request, next_ctx)` to invoke the next intercept or the original LLM call, or skip calling it to short-circuit.
- [Function nemo_relay_register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-llm-request-intercept.md): Register an LLM request intercept. The callback can transform the `LlmRequest` before it reaches the LLM provider.
- [Function nemo_relay_register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-llm-sanitize-request-guardrail.md): Register an LLM request sanitization guardrail. The callback can modify or replace the LLM request before it is sent.
- [Function nemo_relay_register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-llm-sanitize-response-guardrail.md): Register an LLM response sanitization guardrail. The callback can inspect and modify the LLM response after it is received.
- [Function nemo_relay_register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-llm-stream-execution-intercept.md): Register an LLM streaming execution intercept following the middleware chain pattern. The callback receives `(request, next_fn, next_ctx)` - call `next_fn(request, next_ctx)` to invoke the next intercept or the original streaming LLM call, or skip calling it to short-circuit.
- [Function nemo_relay_register_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-plugin.md): Register a plugin backed by foreign callbacks.
- [Function nemo_relay_register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-subscriber.md): Register an event subscriber. The callback is invoked for every lifecycle event emitted by the runtime.
- [Function nemo_relay_register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-tool-conditional-execution-guardrail.md): Register a tool conditional execution guardrail. The callback decides whether a tool call should proceed. Returns an error message to reject, or null to allow.
- [Function nemo_relay_register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-tool-execution-intercept.md): Register a tool execution intercept following the middleware chain pattern. The callback receives `(args, next_fn, next_ctx)` - call `next_fn(args, next_ctx)` to invoke the next intercept or the original tool function, or skip calling it to short-circuit.
- [Function nemo_relay_register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-tool-request-intercept.md): Register a tool request intercept. The callback can transform tool arguments before execution. Runs after request guardrails in the middleware pipeline.
- [Function nemo_relay_register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-tool-sanitize-request-guardrail.md): Register a tool request sanitization guardrail. The callback can inspect and modify tool arguments before the tool executes.
- [Function nemo_relay_register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-register-tool-sanitize-response-guardrail.md): Register a tool response sanitization guardrail. The callback can inspect and modify tool results after the tool executes.
- [Function nemo_relay_scope_deregister_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-llm-conditional-execution-guardrail.md): Deregister a scope-local LLM conditional execution guardrail by name.
- [Function nemo_relay_scope_deregister_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-llm-execution-intercept.md): Deregister a scope-local LLM execution intercept by name.
- [Function nemo_relay_scope_deregister_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-llm-request-intercept.md): Deregister a scope-local LLM request intercept by name.
- [Function nemo_relay_scope_deregister_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-llm-sanitize-request-guardrail.md): Deregister a scope-local LLM request sanitization guardrail by name.
- [Function nemo_relay_scope_deregister_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-llm-sanitize-response-guardrail.md): Deregister a scope-local LLM response sanitization guardrail by name.
- [Function nemo_relay_scope_deregister_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-llm-stream-execution-intercept.md): Deregister a scope-local LLM streaming execution intercept by name.
- [Function nemo_relay_scope_deregister_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-subscriber.md): Deregister a scope-local event subscriber by name.
- [Function nemo_relay_scope_deregister_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-tool-conditional-execution-guardrail.md): Deregister a scope-local tool conditional execution guardrail by name.
- [Function nemo_relay_scope_deregister_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-tool-execution-intercept.md): Deregister a scope-local tool execution intercept by name.
- [Function nemo_relay_scope_deregister_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-tool-request-intercept.md): Deregister a scope-local tool request intercept by name.
- [Function nemo_relay_scope_deregister_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-tool-sanitize-request-guardrail.md): Deregister a scope-local tool request sanitization guardrail by name.
- [Function nemo_relay_scope_deregister_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-deregister-tool-sanitize-response-guardrail.md): Deregister a scope-local tool response sanitization guardrail by name.
- [Function nemo_relay_scope_register_llm_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-llm-conditional-execution-guardrail.md): Register a scope-local LLM conditional execution guardrail.
- [Function nemo_relay_scope_register_llm_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-llm-execution-intercept.md): Register a scope-local LLM execution intercept following the middleware chain pattern.
- [Function nemo_relay_scope_register_llm_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-llm-request-intercept.md): Register a scope-local LLM request intercept.
- [Function nemo_relay_scope_register_llm_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-llm-sanitize-request-guardrail.md): Register a scope-local LLM request sanitization guardrail.
- [Function nemo_relay_scope_register_llm_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-llm-sanitize-response-guardrail.md): Register a scope-local LLM response sanitization guardrail.
- [Function nemo_relay_scope_register_llm_stream_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-llm-stream-execution-intercept.md): Register a scope-local LLM streaming execution intercept following the middleware chain pattern.
- [Function nemo_relay_scope_register_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-subscriber.md): Register a scope-local event subscriber.
- [Function nemo_relay_scope_register_tool_conditional_execution_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-tool-conditional-execution-guardrail.md): Register a scope-local tool conditional execution guardrail.
- [Function nemo_relay_scope_register_tool_execution_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-tool-execution-intercept.md): Register a scope-local tool execution intercept following the middleware chain pattern.
- [Function nemo_relay_scope_register_tool_request_intercept](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-tool-request-intercept.md): Register a scope-local tool request intercept.
- [Function nemo_relay_scope_register_tool_sanitize_request_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-tool-sanitize-request-guardrail.md): Register a scope-local tool request sanitization guardrail.
- [Function nemo_relay_scope_register_tool_sanitize_response_guardrail](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-register-tool-sanitize-response-guardrail.md): Register a scope-local tool response sanitization guardrail.
- [Function nemo_relay_scope_stack_active](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-stack-active.md): Returns whether the current execution context has an explicitly-initialized scope stack.
- [Function nemo_relay_scope_stack_capture_thread](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-stack-capture-thread.md): Capture the current thread-local scope stack binding.
- [Function nemo_relay_scope_stack_create](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-stack-create.md): Create a new isolated scope stack with its own root scope.
- [Function nemo_relay_scope_stack_restore_thread](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-stack-restore-thread.md): Restore and free a captured thread-local scope stack binding.
- [Function nemo_relay_scope_stack_set_thread](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-scope-stack-set-thread.md): Bind an isolated scope stack to the current OS thread.
- [Function nemo_relay_stream_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-stream-free.md): Free a stream handle and release its resources.
- [Function nemo_relay_stream_next](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-stream-next.md): Poll the next chunk from a streaming LLM response. Blocks until a chunk is available.
- [Function nemo_relay_tool_call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-tool-call.md): Begin a manual tool call lifecycle span.
- [Function nemo_relay_tool_call_end](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-tool-call-end.md): End a manual tool call lifecycle span.
- [Function nemo_relay_tool_call_execute](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-tool-call-execute.md): Execute a tool call end-to-end: run conditional-execution guardrails (on raw args), then request intercepts, sanitize-request guardrails, execution intercepts, the callback, and sanitize-response guardrails. On rejection, only a standalone Mark event is emitted (no Start/End pair) and `GuardrailRejected` is returned. Blocks the calling thread until completion.
- [Function nemo_relay_tool_conditional_execution](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-tool-conditional-execution.md): Run the registered tool conditional execution guardrail chain.
- [Function nemo_relay_tool_request_intercepts](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-tool-request-intercepts.md): Run the registered tool request intercept chain on the given arguments.
- [Function nemo_relay_validate_plugin_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/api/fn-nemo-relay-validate-plugin-config.md): Validate a generic plugin config document and return the diagnostics report as JSON.
- [Module callable](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable.md): C function pointer typedefs and wrapper functions for FFI callbacks.
- [Function wrap_codec_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-codec-fn.md): Wrap a pair of C codec callbacks into an `Arc<dyn LlmCodec>`.
- [Function wrap_collector_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-collector-fn.md): Wrap a C collector callback into a `Box<dyn FnMut(Json) -> Result<()> + Send>` for use by the core runtime. Each intercepted chunk Json is serialized to a JSON string and passed to the callback.
- [Function wrap_event_subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-event-subscriber.md): Wrap a C event subscriber callback into a Rust closure.
- [Function wrap_finalizer_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-finalizer-fn.md): Wrap a C finalizer callback into a `Box<dyn FnOnce() -> Json + Send>` for use by the core runtime. The callback is invoked exactly once when the stream is exhausted. The returned C string is parsed as JSON and then freed.
- [Function wrap_json_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-json-fn.md): Wrap a generic C JSON callback into a Rust closure.
- [Function wrap_llm_conditional_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-conditional-fn.md): Wrap a C LLM conditional callback into a Rust closure.
- [Function wrap_llm_exec_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-exec-fn.md): Wrap a C LLM execution callback into an async Rust closure. The C callback receives an `LlmRequest` serialized as a JSON string.
- [Function wrap_llm_exec_intercept_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-exec-intercept-fn.md): Wrap a C LLM execution intercept callback into an `Arc<dyn Fn(LlmRequest, LlmExecutionNextFn) -> ...>`.
- [Function wrap_llm_request_intercept_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-request-intercept-fn.md): Wrap a C LLM request intercept callback (annotated-aware) into a Rust `LlmRequestInterceptFn` closure. The callback receives the intercept name, the opaque `FfiLLMRequest`, and the annotated JSON (or null). It writes one owned canonical outcome JSON string.
- [Function wrap_llm_response_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-response-fn.md): Wrap a C JSON callback into a `Fn(Json) -> Json` closure for LLM response sanitization. The callback receives the response as a JSON string and returns the (possibly modified) JSON string.
- [Function wrap_llm_sanitize_request_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-sanitize-request-fn.md): Wrap a C LLM request sanitize callback into a Rust closure.
- [Function wrap_llm_stream_exec_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-stream-exec-fn.md): Wrap a C LLM execution callback into an async Rust closure that returns a stream. The C callback returns the full response as a single JSON string, which is emitted as a single-item stream of Json values.
- [Function wrap_llm_stream_exec_intercept_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-llm-stream-exec-intercept-fn.md): Wrap a C LLM stream execution intercept callback. Since the C callback returns a single string (not a real stream), this wraps it as a single-item stream, same as `wrap_llm_stream_exec_fn`.
- [Function wrap_tool_conditional_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-tool-conditional-fn.md): Wrap a C tool conditional callback into a Rust closure for use by the core runtime.
- [Function wrap_tool_exec_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-tool-exec-fn.md): Wrap a C tool execution callback into an async Rust closure.
- [Function wrap_tool_exec_intercept_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-tool-exec-intercept-fn.md): Wrap a C tool execution intercept callback into a `ToolExecutionFn`.
- [Function wrap_tool_request_intercept_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-tool-request-intercept-fn.md): Wrap a C tool request intercept callback into a Rust closure for use by the core runtime.
- [Function wrap_tool_sanitize_fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/fn-wrap-tool-sanitize-fn.md): Wrap a C tool sanitize callback into a Rust closure for use by the core runtime.
- [Type Alias Nemo Relay Codec Decode Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaycodecdecodecb.md): Callback for Codec decode: translates an opaque `FfiLLMRequest` into an `AnnotatedLLMRequest` JSON string. Returns a heap-allocated C string on success, or null on error (after setting the last error message).
- [Type Alias Nemo Relay Codec Decode Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaycodecdecodefn.md): Nullable version of `NemoRelayCodecDecodeCb` for use as an optional parameter in FFI execute functions. Pass null to indicate no codec.
- [Type Alias Nemo Relay Codec Encode Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaycodecencodecb.md): Callback for Codec encode: merges structured changes back into opaque request content. Receives the annotated request as a JSON C string and the original `FfiLLMRequest`. Returns a heap-allocated JSON C string representing the new `LlmRequest` content on success, or null on error.
- [Type Alias Nemo Relay Codec Encode Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaycodecencodefn.md): Nullable version of `NemoRelayCodecEncodeCb` for use as an optional parameter in FFI execute functions. Pass null to indicate no codec.
- [Type Alias Nemo Relay Collector Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaycollectorcb.md): Callback for collecting intercepted stream chunks. Invoked with each chunk (after stream execution intercepts have been applied) as a null-terminated C string. The string is only valid for the duration of the call.
- [Type Alias Nemo Relay Event Subscriber Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayeventsubscribercb.md): Callback for event subscribers. Invoked on each lifecycle event emitted by the runtime. The `FfiEvent` pointer is only valid for the duration of the call.
- [Type Alias Nemo Relay Finalizer Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayfinalizercb.md): Callback for finalizing a collected stream. Invoked once when the stream is exhausted. Must return a JSON C string representing the aggregated response. The returned string must be allocated with `malloc` or equivalent; the runtime will free it.
- [Type Alias Nemo Relay Free Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayfreefn.md): Optional destructor for user data passed to callbacks. Called when the runtime no longer needs the associated callback.
- [Type Alias Nemo Relay Json Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayjsoncb.md): Generic JSON-to-JSON callback, used for LLM response sanitization and intercepts. The returned string must be allocated with `malloc` or equivalent.
- [Type Alias Nemo Relay LlmConditional Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayllmconditionalcb.md): Callback for LLM conditional execution guardrails. Returns NULL to allow execution, or an error message string to reject.
- [Type Alias Nemo Relay LlmExec Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayllmexeccb.md): Callback for LLM execution (default callable). Receives a native JSON C string, returns the response as a JSON C string.
- [Type Alias Nemo Relay LlmExec Intercept Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayllmexecinterceptcb.md): Callback for LLM execution intercepts with middleware chain support. Receives native JSON C string plus a `next` callback and its context.
- [Type Alias Nemo Relay LlmExec Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayllmexecnextfn.md): Runtime-provided "next" callback for LLM execution middleware chain. Takes a native JSON C string, returns a response JSON C string.
- [Type Alias Nemo Relay LlmRequest Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayllmrequestcb.md): Callback for LLM request sanitization. Receives an `FfiLLMRequest` and returns a new (possibly modified) `FfiLLMRequest`. Return null to use defaults.
- [Type Alias Nemo Relay LlmRequest Intercept Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelayllmrequestinterceptcb.md): C callback type for LLM request intercepts with unified annotated-aware signature. Receives the intercept name, the opaque `FfiLLMRequest`, and optionally the annotated request as a JSON C string (null if no Codec resolved). Writes one owned canonical outcome JSON string to `out_outcome_json`. Any non-null string written there must be allocated by `nemo_relay_llm_request_intercept_outcome_json_new` or by an allocation compatible with `nemo_relay_string_free`. Ownership transfers to Relay when the callback returns; the callback must not free or reuse the string afterward. Relay frees it exactly once, even when the callback returns an error status. With a Codec, the outcome must preserve request content and return the annotation; only request headers and annotation fields are writable. Returns `NemoRelayStatus`.
- [Type Alias Nemo Relay Plugin Register Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaypluginregistercb.md): Callback for plugin registration. Receives plugin config JSON and a plugin context pointer that is only valid for the duration of the call.
- [Type Alias Nemo Relay Plugin Validate Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaypluginvalidatecb.md): Callback for plugin validation. Receives plugin config JSON and returns a JSON array of diagnostics.
- [Type Alias Nemo Relay Tool Conditional Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaytoolconditionalcb.md): Callback for tool conditional execution guardrails. Receives tool name and arguments as JSON. Returns NULL to allow execution, or an error message string to reject.
- [Type Alias Nemo Relay Tool Exec Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaytoolexeccb.md): Callback for tool execution (default callable). Receives arguments as JSON, returns result as JSON. The returned string must be allocated with `malloc` or equivalent.
- [Type Alias Nemo Relay Tool Exec Intercept Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaytoolexecinterceptcb.md): Callback for tool execution intercepts. Receives arguments as JSON plus a `next` callback and its context. Call `next_fn(args, next_ctx)` to invoke the next layer in the middleware chain, or return directly to short-circuit. The `result` field is passed to the remaining middleware and application; `pending_marks` are Relay-owned lifecycle metadata emitted after the tool-end event and are not included in the application-visible result. The returned JSON must contain a `result` field and may contain a `pending_marks` array. The returned string must be allocated with `malloc` or an equivalent allocation compatible with `nemo_relay_string_free`. Ownership transfers to Relay when the callback returns; the callback must not free or reuse the string afterward, and Relay frees it exactly once.
- [Type Alias Nemo Relay Tool Exec Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaytoolexecnextfn.md): Runtime-provided "next" callback for tool execution middleware chain. Call this from an intercept to invoke the next layer (or original function). `next_ctx` is an opaque pointer managed by the runtime.
- [Type Alias Nemo Relay Tool Sanitize Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/callable/type-nemorelaytoolsanitizecb.md): Callback for tool request/response sanitization guardrails and intercepts. Receives tool name and arguments as JSON, returns sanitized arguments as JSON. The returned string must be allocated with `malloc` or equivalent.
- [Module convert](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert.md): Conversion utilities between C strings/JSON and Rust types.
- [Function c_str_to_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-c-str-to-json.md): Parse a null-terminated C string as JSON. Returns `None` on error and sets last_error.
- [Function c_str_to_opt_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-c-str-to-opt-json.md): Parse a null-terminated C string to an optional JSON value. Returns `Ok(None)` for null pointers, `Ok(Some(v))` for valid JSON.
- [Function c_str_to_string](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-c-str-to-string.md): Parse a C string to a Rust String. Returns Err status on failure.
- [Function json_to_c_string](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-json-to-c-string.md): Convert a JSON value to a library-owned C string. The caller must free with `nemo_relay_string_free`.
- [Function nemo_relay_string_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-nemo-relay-string-free.md): Free a C string previously returned by any `nemo_relay_*` accessor function. Passing null is a safe no-op.
- [Function str_to_c_string](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-str-to-c-string.md): Convert a Rust &str to a library-owned C string.
- [Function unix_micros_to_opt_timestamp](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/convert/fn-unix-micros-to-opt-timestamp.md): Parse an optional Unix timestamp in microseconds since epoch to UTC.
- [Module error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error.md): Error handling for the FFI layer.
- [Enum Nemo Relay Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/enum-nemorelaystatus.md): Status codes returned by all FFI functions.
- [Function clear_last_error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-clear-last-error.md): Clear the thread-local last-error message.
- [Function last_error_message](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-last-error-message.md): Retrieve the last error message set on this thread, if any.
- [Function nemo_relay_last_error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-nemo-relay-last-error.md): Retrieve the last error message set on this thread, or null if no error has occurred since the last `clear_last_error` call.
- [Function nemo_relay_set_last_error_message](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-nemo-relay-set-last-error-message.md): Set the thread-local last-error message from foreign code.
- [Function set_last_error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-set-last-error.md): Store an error message in thread-local storage for later retrieval.
- [Function status_from_error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-status-from-error.md): Convert an `FlowError` to an `NemoRelayStatus`, storing the error message in thread-local storage.
- [Function status_from_plugin_error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/error/fn-status-from-plugin-error.md): Convert a `PluginError` to an `NemoRelayStatus`, storing the error message in thread-local storage.
- [Module types](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types.md): C-compatible types exposed through the FFI boundary.
- [Struct FfiAdaptive Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiadaptiveruntime.md): Opaque owned adaptive runtime handle.
- [Struct FfiAtif Exporter](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiatifexporter.md): Opaque ATIF exporter handle.
- [Struct FfiAtof Exporter](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiatofexporter.md): Opaque ATOF JSONL exporter handle.
- [Struct FfiCodec Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-fficodechandle.md): Opaque handle carrying both request and response codec trait objects.
- [Struct FfiEvent](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffievent.md): Opaque wrapper around a lifecycle event emitted by the runtime.
- [Struct FfiLLM Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffillmhandle.md): Opaque handle representing an active LLM call.
- [Struct FfiLLM Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffillmrequest.md): Opaque wrapper around an LLM request (headers, content).
- [Struct FfiOpen Inference Subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiopeninferencesubscriber.md): Opaque OpenInference subscriber handle.
- [Struct FfiOpen Telemetry Subscriber](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiopentelemetrysubscriber.md): Opaque OpenTelemetry subscriber handle.
- [Struct FfiPlugin Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiplugincontext.md): Opaque plugin registration context.
- [Struct FfiScope Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiscopehandle.md): Opaque handle representing an active execution scope.
- [Struct FfiScope Stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffiscopestack.md): Opaque handle to an isolated scope stack for per-request/per-task isolation.
- [Struct FfiThread Scope Stack Binding](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffithreadscopestackbinding.md): Opaque handle to a captured thread-local scope stack binding.
- [Struct FfiTool Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/struct-ffitoolhandle.md): Opaque handle representing an active tool call.
- [Enum Nemo Relay Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/enum-nemorelayscopetype.md): The type of scope in the agent execution hierarchy.
- [Function nemo_relay_adaptive_runtime_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-adaptive-runtime-free.md): Free an adaptive runtime handle previously returned by `nemo_relay_adaptive_runtime_create`.
- [Function nemo_relay_atif_exporter_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-atif-exporter-free.md): Free an ATIF exporter handle previously returned by `nemo_relay_atif_exporter_create`.
- [Function nemo_relay_atof_exporter_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-atof-exporter-free.md): Free an ATOF JSONL exporter handle previously returned by `nemo_relay_atof_exporter_create`.
- [Function nemo_relay_codec_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-codec-free.md): Free a codec handle previously returned by one of the codec constructor functions (`nemo_relay_openai_chat_codec_new`, etc.).
- [Function nemo_relay_event_annotated_request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-annotated-request.md): Return the annotated request from an LLM start event as a JSON C string, or null if not available (non-LLM events, or no codec was active). Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_annotated_response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-annotated-response.md): Return the annotated response from an LLM end event as a JSON C string, or null if not available (non-LLM events, or no response codec was active). Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_atof_version](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-atof-version.md): Return the ATOF version as a C string.
- [Function nemo_relay_event_attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-attributes.md): Return the raw attribute bitfield for an event, or 0 if it has none.
- [Function nemo_relay_event_attributes_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-attributes-json.md): Return ATOF attributes as a JSON string array.
- [Function nemo_relay_event_category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-category.md): Return the ATOF category as a C string, or null if absent.
- [Function nemo_relay_event_category_profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-category-profile.md): Return the ATOF category profile as a JSON C string, or null if absent.
- [Function nemo_relay_event_data](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-data.md): Return the event data as a JSON C string, or null if no data is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_data_schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-data-schema.md): Return the Agent Trajectory Observability Format (ATOF) data schema as a JSON C string, or null if absent.
- [Function nemo_relay_event_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-free.md): Free an event object.
- [Function nemo_relay_event_input](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-input.md): Return the event input as a JSON C string, or null if no input is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-json.md): Return the canonical subscriber event JSON as a C string. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_kind](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-kind.md): Return the event discriminator as a C string. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_metadata](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-metadata.md): Return the event metadata as a JSON C string, or null if no metadata is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_model_name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-model-name.md): Return the event model name as a C string, or null if no model name is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-name.md): Return the name of an event as a C string, or null if unnamed. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_output](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-output.md): Return the event output as a JSON C string, or null if no output is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_parent_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-parent-uuid.md): Return the event parent UUID as a C string, or null if no parent UUID is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_scope_category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-scope-category.md): Return the ATOF scope category as a C string, or null for mark events.
- [Function nemo_relay_event_scope_type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-scope-type.md): Return the event scope type as a C string, or null if no scope type is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_timestamp](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-timestamp.md): Return the event timestamp as an RFC 3339 C string. Caller must free the result.
- [Function nemo_relay_event_tool_call_id](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-tool-call-id.md): Return the event tool call ID as a C string, or null if no tool call ID is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_event_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-event-uuid.md): Return the UUID of an event as a C string. Caller must free the result.
- [Function nemo_relay_llm_handle_attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-handle-attributes.md): Return the bitfield attributes of an LLM handle. Returns 0 if `ptr` is null.
- [Function nemo_relay_llm_handle_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-handle-free.md): Free an LLM handle previously returned by the runtime.
- [Function nemo_relay_llm_handle_name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-handle-name.md): Return the name of an LLM handle as a C string. Caller must free the result.
- [Function nemo_relay_llm_handle_parent_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-handle-parent-uuid.md): Return the parent scope UUID of an LLM handle, or null if none. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_llm_handle_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-handle-uuid.md): Return the UUID of an LLM handle as a C string. Caller must free the result.
- [Function nemo_relay_llm_request_content](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-request-content.md): Return the content of an LLM request as a JSON C string. Caller must free the result.
- [Function nemo_relay_llm_request_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-request-free.md): Free an LLM request object.
- [Function nemo_relay_llm_request_headers](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-request-headers.md): Return the headers of an LLM request as a JSON C string. Caller must free the result.
- [Function nemo_relay_llm_request_new](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-llm-request-new.md): Create a new LLM request object. Returns a heap-allocated `FfiLLMRequest` that must be freed with `nemo_relay_llm_request_free`. Returns null on invalid input.
- [Function nemo_relay_openinference_subscriber_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-openinference-subscriber-free.md): Free an OpenInference subscriber handle previously returned by `nemo_relay_openinference_subscriber_create`.
- [Function nemo_relay_otel_subscriber_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-otel-subscriber-free.md): Free an OpenTelemetry subscriber handle previously returned by `nemo_relay_otel_subscriber_create`.
- [Function nemo_relay_scope_handle_attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-attributes.md): Return the bitfield attributes of a scope handle. Returns 0 if `ptr` is null.
- [Function nemo_relay_scope_handle_data](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-data.md): Return the scope data as a JSON C string, or null if no data is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_scope_handle_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-free.md): Free a scope handle previously returned by the runtime.
- [Function nemo_relay_scope_handle_metadata](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-metadata.md): Return the scope metadata as a JSON C string, or null if no metadata is set. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_scope_handle_name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-name.md): Return the name of a scope handle as a C string. Caller must free the result. Returns null if `ptr` is null.
- [Function nemo_relay_scope_handle_parent_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-parent-uuid.md): Return the parent scope UUID as a C string, or null if there is no parent. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_scope_handle_scope_type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-scope-type.md): Return the scope type of a scope handle. Returns `Unknown` if `ptr` is null.
- [Function nemo_relay_scope_handle_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-handle-uuid.md): Return the UUID of a scope handle as a C string. Caller must free the result with `nemo_relay_string_free`. Returns null if `ptr` is null.
- [Function nemo_relay_scope_stack_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-scope-stack-free.md): Free a scope stack handle previously returned by `nemo_relay_scope_stack_create`.
- [Function nemo_relay_tool_handle_attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-tool-handle-attributes.md): Return the bitfield attributes of a tool handle. Returns 0 if `ptr` is null.
- [Function nemo_relay_tool_handle_free](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-tool-handle-free.md): Free a tool handle previously returned by the runtime.
- [Function nemo_relay_tool_handle_name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-tool-handle-name.md): Return the name of a tool handle as a C string. Caller must free the result.
- [Function nemo_relay_tool_handle_parent_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-tool-handle-parent-uuid.md): Return the parent scope UUID of a tool handle, or null if none. Caller must free the result with `nemo_relay_string_free`.
- [Function nemo_relay_tool_handle_uuid](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-ffi/types/fn-nemo-relay-tool-handle-uuid.md): Return the UUID of a tool handle as a C string. Caller must free the result.
- [nemo-relay-types](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types.md): Shared serializable data model types for NeMo Relay.
- [Module api](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api.md): Public runtime API data types. Shared API data types.
- [Module event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event.md): Lifecycle event DTOs. Event types for Agent Trajectory Observability Format (ATOF) runtime events.
- [Struct Base Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-baseevent.md): Shared event metadata carried by every ATOF event.
- [Struct Category Profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-categoryprofile.md): Category-specific profile data.
- [Struct Data Schema](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-dataschema.md): Identifier for the schema that describes an event's opaque `data` payload.
- [Struct Event Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-eventcategory.md): Semantic category carried by ATOF `category`.
- [Struct Mark Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-markevent.md): ATOF point-in-time mark event.
- [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner.
- [Struct Scope Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-scopeevent.md): ATOF scope lifecycle event.
- [Enum Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime.
- [Enum Scope Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-scopecategory.md): Agent Trajectory Observability Format (ATOF) lifecycle phase for a scope event.
- [Constant ATOF_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/constant-atof-version.md): Agent Trajectory Observability Format (ATOF) protocol version emitted by this runtime.
- [Function attributes_from_handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-attributes-from-handle.md): Convert handle bitflags into ATOF attributes.
- [Function llm_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-llm-attributes-to-strings.md): Convert LLM bitflags into ATOF attributes.
- [Function scope_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-scope-attributes-to-strings.md): Convert scope bitflags into ATOF attributes.
- [Function tool_attributes_to_strings](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-tool-attributes-to-strings.md): Convert tool bitflags into ATOF attributes.
- [Module llm](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/llm.md): LLM DTOs and attributes. Shared LLM data types.
- [Struct LlmAttributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmattributes.md): Bitflags that modify LLM-call behavior and observability.
- [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime.
- [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks.
- [Module scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/scope.md): Scope DTOs and attributes. Shared scope data types.
- [Struct Scope Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/scope/struct-scopeattributes.md): Bitflags that modify scope behavior and observability.
- [Enum Handle Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/scope/enum-handleattributes.md): Attribute bitflags attached to a concrete handle kind.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/scope/enum-scopetype.md): Semantic category attached to a scope lifecycle span.
- [Module tool](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/tool.md): Tool DTOs and attributes. Shared tool data types.
- [Struct Tool Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/tool/struct-toolattributes.md): Bitflags that modify tool-call behavior and observability.
- [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/api/tool/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept.
- [Module codec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec.md): Normalized LLM request and response data types. Shared normalized LLM request and response data types.
- [Module request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request.md): Normalized LLM request data types. LLM request codec types and trait.
- [Struct Annotated LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-annotatedllmrequest.md): Structured view of an LLM request, produced by a Codec from opaque `LlmRequest` content.
- [Struct Function Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-functioncall.md): A function call within a tool call.
- [Struct Function Definition](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-functiondefinition.md): A function definition within a tool definition.
- [Struct Generation Params](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-generationparams.md): Normalized generation parameters across providers.
- [Struct Open AiImage Url](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-openaiimageurl.md): OpenAI image URL payload.
- [Struct Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-toolcall.md): A tool call requested by the assistant.
- [Struct Tool Choice Function](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-toolchoicefunction.md): A specific tool choice that forces a named function.
- [Struct Tool Choice Function Name](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-toolchoicefunctionname.md): The name component of a specific tool choice.
- [Struct Tool Definition](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-tooldefinition.md): A tool definition (function schema) available to the model.
- [Enum Content Part](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-contentpart.md): A single content part within a multimodal message.
- [Enum Message](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-message.md): A single message in a conversation, tagged by role.
- [Enum Message Content](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-messagecontent.md): Message content: either a plain string or multimodal parts array.
- [Enum Tool Choice](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-toolchoice.md): Tool choice control: how the model should use available tools.
- [Module response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response.md): Normalized LLM response data types. Normalized LLM response types produced by response codecs.
- [Struct Annotated LlmResponse](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-annotatedllmresponse.md): Structured view of an LLM response, produced by a response codec from raw JSON API output.
- [Struct Cost Estimate](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-costestimate.md): Normalized LLM response cost.
- [Struct Response Tool Call](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-responsetoolcall.md): A tool call requested by the model in its response.
- [Struct Usage](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-usage.md): Token usage statistics from an LLM API response.
- [Enum ApiSpecific Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/enum-apispecificresponse.md): API-specific response data that cannot be normalized across providers.
- [Enum Cost Source](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/enum-costsource.md): Source of a normalized cost value.
- [Enum Finish Reason](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/codec/response/enum-finishreason.md): Normalized reason why the model stopped generating.
- [Module plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/plugin.md): Plugin configuration diagnostic data types. Shared plugin diagnostic data types.
- [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/plugin/struct-configdiagnostic.md): Structured validation diagnostic for plugin validation.
- [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/plugin/enum-diagnosticlevel.md): Diagnostic severity returned by plugin validation.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-types/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.
- [nemo-relay-plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin.md): Stable native plugin ABI and Rust authoring helpers for NeMo Relay.
- [Macro nemo_relay_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/macro-nemo-relay-plugin.md): Exports a concrete plugin constructor as a native plugin entry symbol body.
- [Struct Annotated LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-annotatedllmrequest.md): Structured view of an LLM request, produced by a Codec from opaque `LlmRequest` content.
- [Struct Annotated LlmResponse](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-annotatedllmresponse.md): Structured view of an LLM response, produced by a response codec from raw JSON API output.
- [Struct Category Profile](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-categoryprofile.md): Category-specific profile data.
- [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-configdiagnostic.md): Structured validation diagnostic for plugin validation.
- [Struct Event Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-eventcategory.md): Semantic category carried by ATOF `category`.
- [Struct LlmAttributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-llmattributes.md): Bitflags that modify LLM-call behavior and observability.
- [Struct LlmNext](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-llmnext.md): Typed continuation passed to LLM execution intercepts.
- [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime.
- [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks.
- [Struct LlmStream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-llmstream.md): Host- or plugin-owned stream returned across the native LLM stream ABI.
- [Struct LlmStream Next](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-llmstreamnext.md): Typed continuation passed to LLM stream execution intercepts.
- [Struct Nemo Relay Native Host ApiV1](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativehostapiv1.md): Versioned host API table passed to native plugin entry symbols.
- [Struct Nemo Relay Native LlmStream V1](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativellmstreamv1.md): Native LLM JSON stream handle table.
- [Struct Nemo Relay Native Plugin Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativeplugincontext.md): Opaque plugin registration context borrowed from the host during registration.
- [Struct Nemo Relay Native Plugin V1](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativepluginv1.md): Versioned plugin descriptor returned by native plugin entry symbols.
- [Struct Nemo Relay Native Scope Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativescopehandle.md): Opaque host-owned scope handle.
- [Struct Nemo Relay Native Scope Stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativescopestack.md): Opaque host-owned scope stack handle.
- [Struct Nemo Relay Native Scope Stack Binding](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativescopestackbinding.md): Opaque host-owned captured scope-stack binding.
- [Struct Nemo Relay Native String](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-nemorelaynativestring.md): Opaque host-owned UTF-8 string or JSON byte buffer.
- [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner.
- [Struct Plugin Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-plugincontext.md): Borrowed safe wrapper around a host plugin registration context.
- [Struct Plugin Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-pluginruntime.md): Cloneable high-level runtime handle for host APIs available to native plugins.
- [Struct Scope Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-scopeattributes.md): Bitflags that modify scope behavior and observability.
- [Struct Scope Guard](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-scopeguard.md): RAII guard for a host scope opened by `PluginRuntime::scope`.
- [Struct Scope Handle](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-scopehandle.md): Host-owned scope handle returned by native scope APIs.
- [Struct Scope Stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-scopestack.md): Host-owned isolated scope stack returned by native scope-stack APIs.
- [Struct Scope Stack Binding](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-scopestackbinding.md): Captured thread-local scope-stack binding.
- [Struct Thread Scope Stack Guard](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-threadscopestackguard.md): RAII guard that restores the previous thread-local scope stack on drop.
- [Struct Tool Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-toolattributes.md): Bitflags that modify tool-call behavior and observability.
- [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept.
- [Struct Tool Next](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/struct-toolnext.md): Typed continuation passed to tool execution intercepts.
- [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-diagnosticlevel.md): Diagnostic severity returned by plugin validation.
- [Enum Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime.
- [Enum Handle Attributes](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-handleattributes.md): Attribute bitflags attached to a concrete handle kind.
- [Enum Nemo Relay Native Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-nemorelaynativescopetype.md): Scope category used by native plugins when opening scopes.
- [Enum Nemo Relay Status](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-nemorelaystatus.md): Status codes returned by stable native ABI functions.
- [Enum Scope Category](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-scopecategory.md): Agent Trajectory Observability Format (ATOF) lifecycle phase for a scope event.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/enum-scopetype.md): Semantic category attached to a scope lifecycle span.
- [Constant NEMO_RELAY_NATIVE_ABI_VERSION](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/constant-nemo-relay-native-abi-version.md): Native plugin ABI version supported by this crate.
- [Trait Native Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/trait-nativeplugin.md): Trait implemented by Rust native plugins.
- [Function capture_scope_stack_thread](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-capture-scope-stack-thread.md): Captures the current thread-local scope-stack binding.
- [Function create_scope_stack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-create-scope-stack.md): Creates a new independent scope stack.
- [Function current_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-current-scope.md): Retrieves the current scope handle.
- [Function emit_mark](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-emit-mark.md): Emits a mark event under the current scope.
- [Function export_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-export-plugin.md): Initializes a native plugin descriptor for a Rust SDK plugin value.
- [Function pop_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-pop-scope.md): Pops a scope and emits its end event.
- [Function push_scope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/fn-push-scope.md): Pushes a scope and emits its start event.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.
- [Type Alias LlmJson Stream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-llmjsonstream.md): Synchronous JSON chunk stream used by native LLM stream intercept helpers.
- [Type Alias Nemo Relay Native Event Subscriber Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativeeventsubscribercb.md): Native event subscriber callback.
- [Type Alias Nemo Relay Native Free Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativefreefn.md): Optional destructor for user data captured by native callbacks.
- [Type Alias Nemo Relay Native Json Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativejsoncb.md): Native JSON transform callback for LLM response sanitizers.
- [Type Alias Nemo Relay Native LlmConditional Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmconditionalcb.md): Native LLM conditional-execution callback.
- [Type Alias Nemo Relay Native LlmExecution Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmexecutioncb.md): Native LLM execution intercept callback.
- [Type Alias Nemo Relay Native LlmNext Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmnextfn.md): Runtime-provided continuation for LLM execution intercepts.
- [Type Alias Nemo Relay Native LlmRequest Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmrequestcb.md): Native LLM request transform callback for request sanitizers.
- [Type Alias Nemo Relay Native LlmRequest Intercept Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmrequestinterceptcb.md): Native LLM request intercept callback.
- [Type Alias Nemo Relay Native LlmStream Cancel Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmstreamcancelfn.md): Optional native stream cancellation callback.
- [Type Alias Nemo Relay Native LlmStream Drop Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmstreamdropfn.md): Optional native stream destructor callback.
- [Type Alias Nemo Relay Native LlmStream Execution Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmstreamexecutioncb.md): Native LLM stream execution intercept callback.
- [Type Alias Nemo Relay Native LlmStream Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmstreamnextfn.md): Runtime-provided continuation for LLM stream execution intercepts.
- [Type Alias Nemo Relay Native LlmStream Poll Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativellmstreampollfn.md): Native stream poll callback.
- [Type Alias Nemo Relay Native Plugin Drop Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativeplugindropfn.md): Native plugin drop callback.
- [Type Alias Nemo Relay Native Plugin Entry](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativepluginentry.md): Native entry symbol type loaded by the host.
- [Type Alias Nemo Relay Native Plugin Register Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativepluginregisterfn.md): Native plugin registration callback.
- [Type Alias Nemo Relay Native Plugin Validate Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativepluginvalidatefn.md): Native plugin validation callback.
- [Type Alias Nemo Relay Native Tool Conditional Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativetoolconditionalcb.md): Native tool conditional-execution callback.
- [Type Alias Nemo Relay Native Tool Execution Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativetoolexecutioncb.md): Native tool execution intercept callback.
- [Type Alias Nemo Relay Native Tool Json Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativetooljsoncb.md): Native JSON transform callback for tool request/response sanitizers and tool request intercepts.
- [Type Alias Nemo Relay Native Tool Next Fn](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativetoolnextfn.md): Runtime-provided continuation for tool execution intercepts.
- [Type Alias Nemo Relay Native With Scope Stack Cb](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-nemorelaynativewithscopestackcb.md): Native callback executed while a host scope stack is temporarily active.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-plugin/type-result.md): Result type used by the Rust native plugin SDK.
- [nemo-relay-worker-proto](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto.md): Versioned gRPC protocol for NeMo Relay out-of-process worker plugins.
- [Module v1](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1.md): Generated protobuf and gRPC service definitions.
- [Module invoke_request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/invoke_request.md): Nested message and enum types in `InvokeRequest`.
- [Enum Payload](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/invoke_request/enum-payload.md): API documentation for the Rust `Payload` enum in crate `nemo_relay_worker_proto`.
- [Module invoke_response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/invoke_response.md): Nested message and enum types in `InvokeResponse`.
- [Enum Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/invoke_response/enum-result.md): API documentation for the Rust `Result` enum in crate `nemo_relay_worker_proto`.
- [Module plugin_worker_client](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/plugin_worker_client.md): Generated client implementations.
- [Struct Plugin Worker Client](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/plugin_worker_client/struct-pluginworkerclient.md): API documentation for the Rust `PluginWorkerClient` struct in crate `nemo_relay_worker_proto`.
- [Module plugin_worker_server](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/plugin_worker_server.md): Generated server implementations.
- [Struct Plugin Worker Server](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/plugin_worker_server/struct-pluginworkerserver.md): API documentation for the Rust `PluginWorkerServer` struct in crate `nemo_relay_worker_proto`.
- [Constant SERVICE_NAME](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/plugin_worker_server/constant-service-name.md): Generated gRPC service name
- [Trait Plugin Worker](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/plugin_worker_server/trait-pluginworker.md): Generated trait containing gRPC methods that should be implemented for use with PluginWorkerServer.
- [Module relay_host_runtime_client](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/relay_host_runtime_client.md): Generated client implementations.
- [Struct Relay Host Runtime Client](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/relay_host_runtime_client/struct-relayhostruntimeclient.md): API documentation for the Rust `RelayHostRuntimeClient` struct in crate `nemo_relay_worker_proto`.
- [Module relay_host_runtime_server](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/relay_host_runtime_server.md): Generated server implementations.
- [Struct Relay Host Runtime Server](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/relay_host_runtime_server/struct-relayhostruntimeserver.md): API documentation for the Rust `RelayHostRuntimeServer` struct in crate `nemo_relay_worker_proto`.
- [Constant SERVICE_NAME](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/relay_host_runtime_server/constant-service-name.md): Generated gRPC service name
- [Trait Relay Host Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/relay_host_runtime_server/trait-relayhostruntime.md): Generated trait containing gRPC methods that should be implemented for use with RelayHostRuntimeServer.
- [Module stream_chunk](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/stream_chunk.md): Nested message and enum types in `StreamChunk`.
- [Enum Item](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/stream_chunk/enum-item.md): API documentation for the Rust `Item` enum in crate `nemo_relay_worker_proto`.
- [Struct Cancel Invocation Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-cancelinvocationrequest.md): API documentation for the Rust `CancelInvocationRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Create Scope Stack Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-createscopestackrequest.md): API documentation for the Rust `CreateScopeStackRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Create Scope Stack Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-createscopestackresponse.md): API documentation for the Rust `CreateScopeStackResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct Drop Scope Stack Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-dropscopestackrequest.md): API documentation for the Rust `DropScopeStackRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Emit Mark Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-emitmarkrequest.md): API documentation for the Rust `EmitMarkRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Empty Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-emptyresult.md): API documentation for the Rust `EmptyResult` struct in crate `nemo_relay_worker_proto`.
- [Struct Guardrail Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-guardrailresult.md): API documentation for the Rust `GuardrailResult` struct in crate `nemo_relay_worker_proto`.
- [Struct Handshake Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-handshakerequest.md): API documentation for the Rust `HandshakeRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Handshake Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-handshakeresponse.md): API documentation for the Rust `HandshakeResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct Health Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-healthrequest.md): API documentation for the Rust `HealthRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Health Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-healthresponse.md): API documentation for the Rust `HealthResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct HostAck](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-hostack.md): API documentation for the Rust `HostAck` struct in crate `nemo_relay_worker_proto`.
- [Struct Invoke Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-invokerequest.md): API documentation for the Rust `InvokeRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Invoke Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-invokeresponse.md): API documentation for the Rust `InvokeResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct Json Envelope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-jsonenvelope.md): API documentation for the Rust `JsonEnvelope` struct in crate `nemo_relay_worker_proto`.
- [Struct Json Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-jsonresult.md): API documentation for the Rust `JsonResult` struct in crate `nemo_relay_worker_proto`.
- [Struct LlmInvocation](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-llminvocation.md): API documentation for the Rust `LlmInvocation` struct in crate `nemo_relay_worker_proto`.
- [Struct LlmNext Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-llmnextrequest.md): API documentation for the Rust `LlmNextRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct LlmRequest Intercept Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-llmrequestinterceptresult.md): API documentation for the Rust `LlmRequestInterceptResult` struct in crate `nemo_relay_worker_proto`.
- [Struct LlmStream Next Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-llmstreamnextrequest.md): API documentation for the Rust `LlmStreamNextRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct PopScope Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-popscoperequest.md): API documentation for the Rust `PopScopeRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Push Scope Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-pushscoperequest.md): API documentation for the Rust `PushScopeRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Push Scope Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-pushscoperesponse.md): API documentation for the Rust `PushScopeResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct Register Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-registerrequest.md): API documentation for the Rust `RegisterRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Register Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-registerresponse.md): API documentation for the Rust `RegisterResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct Registration](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-registration.md): API documentation for the Rust `Registration` struct in crate `nemo_relay_worker_proto`.
- [Struct Scope Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-scopecontext.md): API documentation for the Rust `ScopeContext` struct in crate `nemo_relay_worker_proto`.
- [Struct Shutdown Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-shutdownrequest.md): API documentation for the Rust `ShutdownRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Stream Chunk](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-streamchunk.md): API documentation for the Rust `StreamChunk` struct in crate `nemo_relay_worker_proto`.
- [Struct Tool Execution Intercept Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-toolexecutioninterceptresult.md): API documentation for the Rust `ToolExecutionInterceptResult` struct in crate `nemo_relay_worker_proto`.
- [Struct Tool Invocation](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-toolinvocation.md): API documentation for the Rust `ToolInvocation` struct in crate `nemo_relay_worker_proto`.
- [Struct Tool Next Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-toolnextrequest.md): API documentation for the Rust `ToolNextRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Validate Request](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-validaterequest.md): API documentation for the Rust `ValidateRequest` struct in crate `nemo_relay_worker_proto`.
- [Struct Validate Response](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-validateresponse.md): API documentation for the Rust `ValidateResponse` struct in crate `nemo_relay_worker_proto`.
- [Struct Worker Ack](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-workerack.md): API documentation for the Rust `WorkerAck` struct in crate `nemo_relay_worker_proto`.
- [Struct Worker Error](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/struct-workererror.md): API documentation for the Rust `WorkerError` struct in crate `nemo_relay_worker_proto`.
- [Enum Registration Surface](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/enum-registrationsurface.md): API documentation for the Rust `RegistrationSurface` enum in crate `nemo_relay_worker_proto`.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/v1/enum-scopetype.md): API documentation for the Rust `ScopeType` enum in crate `nemo_relay_worker_proto`.
- [Constant WORKER_PROTOCOL_GRPC_V1](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/constant-worker-protocol-grpc-v1.md): Stable worker protocol identifier accepted by `compat.worker_protocol`.
- [Function decode_json_envelope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/fn-decode-json-envelope.md): Decodes a JSON envelope into the requested DTO type.
- [Function json_envelope](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker-proto/fn-json-envelope.md): Creates a JSON envelope from a serializable DTO.
- [nemo-relay-worker](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker.md): Rust SDK for NeMo Relay out-of-process gRPC worker plugins.
- [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-configdiagnostic.md): Structured validation diagnostic for plugin validation.
- [Struct LlmNext](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-llmnext.md): Continuation handle for LLM execution intercepts.
- [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime.
- [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks.
- [Struct LlmStream Next](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-llmstreamnext.md): Continuation handle for LLM stream execution intercepts.
- [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner.
- [Struct Plugin Context](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-plugincontext.md): Registration context passed to `WorkerPlugin::register`.
- [Struct Plugin Runtime](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-pluginruntime.md): Cloneable handle for calling the Relay host runtime from worker callbacks.
- [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept.
- [Struct Tool Next](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-toolnext.md): Continuation handle for tool execution intercepts.
- [Struct Worker Server Config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/struct-workerserverconfig.md): Explicit worker server configuration for tests and custom launchers.
- [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/enum-diagnosticlevel.md): Diagnostic severity returned by plugin validation.
- [Enum Event](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/enum-scopetype.md): Semantic category attached to a scope lifecycle span.
- [Enum Worker SdkError](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/enum-workersdkerror.md): Error returned by worker SDK callbacks and runtime helpers.
- [Trait Worker Plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/trait-workerplugin.md): Trait implemented by Rust out-of-process worker plugins.
- [Function serve_plugin](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin.md): Serves a worker plugin using environment variables supplied by the Relay host.
- [Function serve_plugin_arc](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin-arc.md): Serves a shared worker plugin using environment variables supplied by the Relay host.
- [Function serve_plugin_arc_with_config](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin-arc-with-config.md): Serves a shared worker plugin using explicit endpoint and authentication configuration.
- [Type Alias BoxFuture Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/type-boxfutureresult.md): Boxed future returned by async worker callbacks.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.
- [Type Alias Json Stream](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/type-jsonstream.md): Boxed JSON stream returned by streaming worker callbacks.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/v0.5.0/reference/api/rust-library-reference/nemo-relay-worker/type-result.md): SDK result type.