Module registry

This page is for NeMo Relay, version dev. For other versions, use one of these documentation indexes: - Latest (v0.11.1) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt - v0.11.1: https://docs.nvidia.com/nemo/relay/v0.11.1/llms.txt - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Global and scope-local middleware registration.

Structs

• RuntimeRegistrationIdentity: Structured identity for a global gateable runtime registration.
• RuntimeRegistrationOwner: Discovery metadata describing the owner of a runtime registration.

Enums

• RuntimeRegistrationKind: A global runtime registration surface that can be selected by a conditional middleware guardrail.
• RuntimeRegistrationOwnerKind: The owner category reported for a global runtime registration.

Functions

• deregister_conditional_middleware_guardrail: Deregister a global conditional middleware guardrail.
• deregister_event_metadata_injector: Deregister a global Event metadata injector.
• deregister_llm_conditional_execution_guardrail: Deregister a global LLM conditional-execution guardrail.
• deregister_llm_execution_intercept: Deregister a global LLM execution intercept.
• deregister_llm_request_intercept: Deregister a global LLM request intercept.
• deregister_llm_sanitize_request_guardrail: Deregister a global LLM sanitize-request guardrail.
• deregister_llm_sanitize_response_guardrail: Deregister a global LLM sanitize-response guardrail.
• deregister_llm_stream_execution_intercept: Deregister a global streaming LLM execution intercept.
• deregister_mark_sanitize_guardrail: Deregister a global mark event sanitizer.
• deregister_scope_sanitize_end_guardrail: Deregister a global scope-end event sanitizer.
• deregister_scope_sanitize_start_guardrail: Deregister a global scope-start event sanitizer.
• deregister_tool_conditional_execution_guardrail: Deregister a global tool conditional-execution guardrail.
• deregister_tool_execution_intercept: Deregister a global tool execution intercept.
• deregister_tool_request_intercept: Deregister a global tool request intercept.
• deregister_tool_sanitize_request_guardrail: Deregister a global tool sanitize-request guardrail.
• deregister_tool_sanitize_response_guardrail: Deregister a global tool sanitize-response guardrail.
• list_runtime_registrations: List a deterministic snapshot of global gateable runtime registrations.
• register_conditional_middleware_guardrail: Register a global conditional middleware guardrail.
• register_event_metadata_injector: Register a global Event metadata injector.
• register_llm_conditional_execution_guardrail: Register a global LLM conditional-execution guardrail. The guardrail can block LLM execution before intercepts or the provider callback run.
• register_llm_execution_intercept: Register a global LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback.
• register_llm_request_intercept: Register a global LLM request intercept. Request intercepts can rewrite or annotate the outgoing LLM request and schedule lifecycle marks for the resulting LLM scope.
• register_llm_sanitize_request_guardrail: Register a global LLM sanitize-request guardrail. The guardrail rewrites only the request payload recorded on emitted start events.
• register_llm_sanitize_response_guardrail: Register a global LLM sanitize-response guardrail. The guardrail rewrites only the response payload recorded on emitted end events.
• register_llm_stream_execution_intercept: Register a global streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback.
• register_mark_sanitize_guardrail: Register a global mark event sanitizer.
• register_scope_sanitize_end_guardrail: Register a global scope-end event sanitizer.
• register_scope_sanitize_start_guardrail: Register a global scope-start event sanitizer.
• register_tool_conditional_execution_guardrail: Register a global tool conditional-execution guardrail. The guardrail can block tool execution before intercepts or the tool callback run.
• register_tool_execution_intercept: Register a global tool execution intercept that receives the full ToolExecutionContext, including the managed tool_call_id. Execution intercepts can wrap or replace the tool callback. Each callback returns a canonical tool execution outcome, while its continuation resolves to the downstream ToolExecutionResult.
• register_tool_request_intercept: Register a global tool request intercept. Request intercepts can rewrite tool arguments before execution.
• register_tool_sanitize_request_guardrail: Register a global tool sanitize-request guardrail. The guardrail rewrites only the tool input recorded on emitted start events.
• register_tool_sanitize_response_guardrail: Register a global tool sanitize-response guardrail. The guardrail rewrites only the tool output recorded on emitted end events.
• scope_deregister_event_metadata_injector: Deregister an Event metadata injector owned by an active scope.
• scope_deregister_llm_conditional_execution_guardrail: Deregister a scope-local LLM conditional-execution guardrail.
• scope_deregister_llm_execution_intercept: Deregister a scope-local LLM execution intercept.
• scope_deregister_llm_request_intercept: Deregister a scope-local LLM request intercept.
• scope_deregister_llm_sanitize_request_guardrail: Deregister a scope-local LLM sanitize-request guardrail.
• scope_deregister_llm_sanitize_response_guardrail: Deregister a scope-local LLM sanitize-response guardrail.
• scope_deregister_llm_stream_execution_intercept: Deregister a scope-local streaming LLM execution intercept.
• scope_deregister_mark_sanitize_guardrail: Deregister a scope-local mark event sanitizer.
• scope_deregister_scope_sanitize_end_guardrail: Deregister a scope-local scope-end event sanitizer.
• scope_deregister_scope_sanitize_start_guardrail: Deregister a scope-local scope-start event sanitizer.
• scope_deregister_tool_conditional_execution_guardrail: Deregister a scope-local tool conditional-execution guardrail.
• scope_deregister_tool_execution_intercept: Deregister a scope-local tool execution intercept.
• scope_deregister_tool_request_intercept: Deregister a scope-local tool request intercept.
• scope_deregister_tool_sanitize_request_guardrail: Deregister a scope-local tool sanitize-request guardrail.
• scope_deregister_tool_sanitize_response_guardrail: Deregister a scope-local tool sanitize-response guardrail.
• scope_register_event_metadata_injector: Register an Event metadata injector owned by an active scope.
• scope_register_llm_conditional_execution_guardrail: Register a scope-local LLM conditional-execution guardrail. The guardrail can block LLM execution inside the owning scope.
• scope_register_llm_execution_intercept: Register a scope-local LLM execution intercept. Execution intercepts can wrap or replace the non-streaming provider callback inside the owning scope.
• scope_register_llm_request_intercept: Register a scope-local LLM request intercept. Request intercepts can rewrite or annotate LLM requests inside the owning scope and schedule lifecycle marks for the resulting LLM scope.
• scope_register_llm_sanitize_request_guardrail: Register a scope-local LLM sanitize-request guardrail. The guardrail rewrites only request payloads emitted under the owning scope.
• scope_register_llm_sanitize_response_guardrail: Register a scope-local LLM sanitize-response guardrail. The guardrail rewrites only response payloads emitted under the owning scope.
• scope_register_llm_stream_execution_intercept: Register a scope-local streaming LLM execution intercept. Execution intercepts can wrap or replace the streaming provider callback inside the owning scope.
• scope_register_mark_sanitize_guardrail: Register a scope-local mark event sanitizer.
• scope_register_scope_sanitize_end_guardrail: Register a scope-local scope-end event sanitizer.
• scope_register_scope_sanitize_start_guardrail: Register a scope-local scope-start event sanitizer.
• scope_register_tool_conditional_execution_guardrail: Register a scope-local tool conditional-execution guardrail. The guardrail can block tool execution inside the owning scope.
• scope_register_tool_execution_intercept: Register a scope-local tool execution intercept that receives the full ToolExecutionContext, including the managed tool_call_id. Execution intercepts can wrap or replace the tool callback inside the owning scope. Each callback returns a canonical tool execution outcome, while its continuation resolves to the downstream ToolExecutionResult.
• scope_register_tool_request_intercept: Register a scope-local tool request intercept. Request intercepts can rewrite tool arguments inside the owning scope.
• scope_register_tool_sanitize_request_guardrail: Register a scope-local tool sanitize-request guardrail. The guardrail rewrites only tool input emitted under the owning scope.
• scope_register_tool_sanitize_response_guardrail: Register a scope-local tool sanitize-response guardrail. The guardrail rewrites only tool output emitted under the owning scope.