> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# nemo-relay-worker

> Rust SDK for NeMo Relay out-of-process gRPC worker plugins.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

Rust SDK for NeMo Relay out-of-process gRPC worker plugins.

## Invocation cancellation

The `grpc-v1` service tracks active unary and streaming callbacks by the host-provided invocation ID. Relay sends `CancelInvocation` when a managed caller is cancelled, an invocation times out, or a host stream is abandoned. The SDK aborts the matching async callback task and reports `worker.cancelled`; cancellation of an unknown, completed, or already cancelled ID returns a negative acknowledgment.

Cancellation is cooperative. Dropping an async callback future releases its Rust-owned resources, but an accepted acknowledgment does not prove that arbitrary blocking work started by the callback has stopped.

## Macros

* [relay\_debug](/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-debug): Emit a formatted debug-level gRPC worker record; await the returned future.
* [relay\_error](/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-error): Emit a formatted error-level gRPC worker record; await the returned future.
* [relay\_info](/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-info): Emit a formatted info-level gRPC worker record; await the returned future.
* [relay\_trace](/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-trace): Emit a formatted trace-level gRPC worker record; await the returned future.
* [relay\_warn](/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-warn): Emit a formatted warn-level gRPC worker record; await the returned future.

## Structs

* [AnnotatedLlmRequest](/reference/api/rust-library-reference/nemo-relay-worker/struct-annotatedllmrequest): Structured view of an LLM request, produced by a Codec from opaque [`LlmRequest`](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequest) content.
* [AnnotatedLlmResponse](/reference/api/rust-library-reference/nemo-relay-worker/struct-annotatedllmresponse): Structured view of an LLM response, produced by a response codec from raw JSON API output.
* [ConditionalMiddlewareGuardrailHandle](/reference/api/rust-library-reference/nemo-relay-worker/struct-conditionalmiddlewareguardrailhandle): Opaque activation-owned key for removing a worker-created gate.
* [ConfigDiagnostic](/reference/api/rust-library-reference/nemo-relay-worker/struct-configdiagnostic): Structured diagnostic reported while validating or activating plugin configuration.
* [DataSchema](/reference/api/rust-library-reference/nemo-relay-worker/struct-dataschema): Identifier for the schema that describes an event's opaque `data` payload.
* [EmitMarkOptions](/reference/api/rust-library-reference/nemo-relay-worker/struct-emitmarkoptions): Optional fields supported by the additive `grpc-v1` mark-emission request.
* [EventCategory](/reference/api/rust-library-reference/nemo-relay-worker/struct-eventcategory): Semantic category carried by ATOF `category`.
* [EventSanitizeFields](/reference/api/rust-library-reference/nemo-relay-worker/struct-eventsanitizefields): Observability fields that event sanitizers may rewrite.
* [LlmExecutionContext](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmexecutioncontext): Invocation-scoped codec identities and operations for an LLM execution interceptor.
* [LlmNext](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmnext): Continuation handle for LLM execution intercepts.
* [LlmOptimizationContribution](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationcontribution): One optimizer's evidence for a change to an LLM call.
* [LlmOptimizationKind](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationkind): Open, forward-compatible optimization classification.
* [LlmOptimizationModel](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationmodel): Model identity used for counterfactual and effective pricing.
* [LlmOptimizationModelTransition](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationmodeltransition): A model change proposed or applied by an optimizer.
* [LlmOptimizationSummary](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationsummary): Close-time accounting attached to the normalized LLM response.
* [LlmOptimizationTokenImpact](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationtokenimpact): Shared token evidence that Relay can aggregate without understanding a plugin payload.
* [LlmOptimizationTokens](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationtokens): Token quantities retained independently from pricing arithmetic.
* [LlmRequest](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequest): JSON-shaped LLM request payload passed through the runtime.
* [LlmRequestInterceptOutcome](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequestinterceptoutcome): Result of an LLM request intercept that can schedule lifecycle marks.
* [LlmSanitizeRequestContext](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmsanitizerequestcontext): Active codec identity and capability for an LLM request.
* [LlmSanitizeResponseContext](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmsanitizeresponsecontext): Active codec identity and capability for an LLM response.
* [LlmStreamNext](/reference/api/rust-library-reference/nemo-relay-worker/struct-llmstreamnext): Continuation handle for LLM stream execution intercepts.
* [MetricEnvelope](/reference/api/rust-library-reference/nemo-relay-worker/struct-metricenvelope): Payload stored in a mark using [`METRIC_DATA_SCHEMA_NAME`](/reference/api/rust-library-reference/nemo-relay-worker/constant-metric-data-schema-name).
* [MetricMeasurement](/reference/api/rust-library-reference/nemo-relay-worker/struct-metricmeasurement): One recording operation in a Relay metric mark.
* [PendingMarkSpec](/reference/api/rust-library-reference/nemo-relay-worker/struct-pendingmarkspec): Mark requested by middleware for materialization by a lifecycle owner.
* [PluginContext](/reference/api/rust-library-reference/nemo-relay-worker/struct-plugincontext): Registration context passed to [`WorkerPlugin::register`](/reference/api/rust-library-reference/nemo-relay-worker/trait-workerplugin).
* [PluginRuntime](/reference/api/rust-library-reference/nemo-relay-worker/struct-pluginruntime): Cloneable handle for calling the Relay host runtime from worker callbacks.
* [RuntimeDiagnostic](/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimediagnostic): One bounded runtime diagnostic reported by the Relay host.
* [RuntimeDiagnostics](/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimediagnostics): Bounded snapshot of active host runtime diagnostics.
* [RuntimeRegistrationIdentity](/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimeregistrationidentity): Structured identity for a global gateable runtime registration.
* [RuntimeRegistrationOwner](/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimeregistrationowner): Discovery metadata describing the owner of a runtime registration.
* [ToolExecutionContext](/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutioncontext): Per-call context supplied to a tool execution intercept.
* [ToolExecutionInterceptOutcome](/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutioninterceptoutcome): Canonical result returned by a tool execution intercept.
* [ToolExecutionResult](/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutionresult): Canonical application-visible result of tool execution.
* [ToolNext](/reference/api/rust-library-reference/nemo-relay-worker/struct-toolnext): Continuation handle for tool execution intercepts.
* [WorkerRequestCodec](/reference/api/rust-library-reference/nemo-relay-worker/struct-workerrequestcodec): Invocation-scoped proxy for the active LLM request codec.
* [WorkerResponseCodec](/reference/api/rust-library-reference/nemo-relay-worker/struct-workerresponsecodec): Invocation-scoped proxy for the active LLM response codec.
* [WorkerServerConfig](/reference/api/rust-library-reference/nemo-relay-worker/struct-workerserverconfig): Explicit worker server configuration for tests and custom launchers.

## Enums

* [BuiltinLlmCodec](/reference/api/rust-library-reference/nemo-relay-worker/enum-builtinllmcodec): Relay's built-in LLM codec identities.
* [DiagnosticLevel](/reference/api/rust-library-reference/nemo-relay-worker/enum-diagnosticlevel): Severity of a plugin configuration or activation diagnostic.
* [Event](/reference/api/rust-library-reference/nemo-relay-worker/enum-event): Tagged union covering the two ATOF event kinds emitted by the runtime.
* [LlmCodecIdentity](/reference/api/rust-library-reference/nemo-relay-worker/enum-llmcodecidentity): Per-call LLM codec identity supplied to sanitizer and SDK callbacks.
* [LlmOptimizationEvidenceQuality](/reference/api/rust-library-reference/nemo-relay-worker/enum-llmoptimizationevidencequality): Whether token evidence was observed directly or estimated.
* [LlmOptimizationSummaryStatus](/reference/api/rust-library-reference/nemo-relay-worker/enum-llmoptimizationsummarystatus): Completeness of close-time optimization accounting.
* [LogSeverity](/reference/api/rust-library-reference/nemo-relay-worker/enum-logseverity): Severity attached to a mark that may be projected as an OpenTelemetry log.
* [MetricKind](/reference/api/rust-library-reference/nemo-relay-worker/enum-metrickind): OpenTelemetry instrument kind represented by a metric measurement mark.
* [MetricValueType](/reference/api/rust-library-reference/nemo-relay-worker/enum-metricvaluetype): Numeric representation used by a metric measurement.
* [PluginLogLevel](/reference/api/rust-library-reference/nemo-relay-worker/enum-pluginloglevel): Process-log severity for records emitted through the Relay host.
* [RuntimeRegistrationKind](/reference/api/rust-library-reference/nemo-relay-worker/enum-runtimeregistrationkind): A global runtime registration surface that can be selected by a conditional middleware guardrail.
* [RuntimeRegistrationOwnerKind](/reference/api/rust-library-reference/nemo-relay-worker/enum-runtimeregistrationownerkind): The owner category reported for a global runtime registration.
* [ScopeType](/reference/api/rust-library-reference/nemo-relay-worker/enum-scopetype): Semantic category attached to a scope lifecycle span.
* [WorkerSdkError](/reference/api/rust-library-reference/nemo-relay-worker/enum-workersdkerror): Error returned by worker SDK callbacks and runtime helpers.

## Constants

* [ANNOTATED\_LLM\_REQUEST\_SCHEMA](/reference/api/rust-library-reference/nemo-relay-worker/constant-annotated-llm-request-schema): Versioned JSON envelope schema for [`AnnotatedLlmRequest`](/reference/api/rust-library-reference/nemo-relay-worker/struct-annotatedllmrequest).
* [METRIC\_DATA\_SCHEMA\_NAME](/reference/api/rust-library-reference/nemo-relay-worker/constant-metric-data-schema-name): Relay-owned schema name for mark payloads containing metric measurements.
* [METRIC\_DATA\_SCHEMA\_VERSION](/reference/api/rust-library-reference/nemo-relay-worker/constant-metric-data-schema-version): Current Relay-owned metric measurement schema version.

## Traits

* [LlmOptimizationPayload](/reference/api/rust-library-reference/nemo-relay-worker/trait-llmoptimizationpayload): Trait implemented by typed plugin payloads embedded in an optimization contribution.
* [WorkerPlugin](/reference/api/rust-library-reference/nemo-relay-worker/trait-workerplugin): Trait implemented by Rust out-of-process worker plugins.

## Functions

* [serve\_plugin](/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin): Serves a worker plugin using environment variables supplied by the Relay host.
* [serve\_plugin\_arc](/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin-arc): Serves a shared worker plugin using environment variables supplied by the Relay host.
* [serve\_plugin\_arc\_with\_config](/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin-arc-with-config): Serves a shared worker plugin using explicit endpoint and authentication configuration.

## Type Aliases

* [BoxFutureResult](/reference/api/rust-library-reference/nemo-relay-worker/type-boxfutureresult): Boxed future returned by async worker callbacks.
* [Json](/reference/api/rust-library-reference/nemo-relay-worker/type-json): Type alias for [`serde_json::Value`](https://docs.rs/serde_json/1.0.149/serde_json/value/enum.Value.html), used as the universal JSON representation throughout NeMo Relay APIs.
* [JsonStream](/reference/api/rust-library-reference/nemo-relay-worker/type-jsonstream): Boxed JSON stream returned by streaming worker callbacks.
* [LlmRequestContext](/reference/api/rust-library-reference/nemo-relay-worker/type-llmrequestcontext): Request codec context supplied to an LLM execution intercept.
* [LlmResponseContext](/reference/api/rust-library-reference/nemo-relay-worker/type-llmresponsecontext): Response codec context supplied to an LLM execution intercept.
* [Result](/reference/api/rust-library-reference/nemo-relay-worker/type-result): SDK result type.

> Rust SDK for NeMo Relay out-of-process gRPC worker plugins.

## Docs

- [Macro relay_debug](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-debug.md): Emit a formatted debug-level gRPC worker record; await the returned future.
- [Macro relay_error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-error.md): Emit a formatted error-level gRPC worker record; await the returned future.
- [Macro relay_info](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-info.md): Emit a formatted info-level gRPC worker record; await the returned future.
- [Macro relay_trace](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-trace.md): Emit a formatted trace-level gRPC worker record; await the returned future.
- [Macro relay_warn](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/macro-relay-warn.md): Emit a formatted warn-level gRPC worker record; await the returned future.
- [Struct Annotated LlmRequest](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-annotatedllmrequest.md): Structured view of an LLM request, produced by a Codec from opaque `LlmRequest` content.
- [Struct Annotated LlmResponse](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-annotatedllmresponse.md): Structured view of an LLM response, produced by a response codec from raw JSON API output.
- [Struct Conditional Middleware Guardrail Handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-conditionalmiddlewareguardrailhandle.md): Opaque activation-owned key for removing a worker-created gate.
- [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-configdiagnostic.md): Structured diagnostic reported while validating or activating plugin configuration.
- [Struct Data Schema](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-dataschema.md): Identifier for the schema that describes an event's opaque `data` payload.
- [Struct Emit Mark Options](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-emitmarkoptions.md): Optional fields supported by the additive `grpc-v1` mark-emission request.
- [Struct Event Category](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-eventcategory.md): Semantic category carried by ATOF `category`.
- [Struct Event Sanitize Fields](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-eventsanitizefields.md): Observability fields that event sanitizers may rewrite.
- [Struct LlmExecution Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmexecutioncontext.md): Invocation-scoped codec identities and operations for an LLM execution interceptor.
- [Struct LlmNext](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmnext.md): Continuation handle for LLM execution intercepts.
- [Struct LlmOptimization Contribution](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationcontribution.md): One optimizer's evidence for a change to an LLM call.
- [Struct LlmOptimization Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationkind.md): Open, forward-compatible optimization classification.
- [Struct LlmOptimization Model](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationmodel.md): Model identity used for counterfactual and effective pricing.
- [Struct LlmOptimization Model Transition](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationmodeltransition.md): A model change proposed or applied by an optimizer.
- [Struct LlmOptimization Summary](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationsummary.md): Close-time accounting attached to the normalized LLM response.
- [Struct LlmOptimization Token Impact](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationtokenimpact.md): Shared token evidence that Relay can aggregate without understanding a plugin payload.
- [Struct LlmOptimization Tokens](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmoptimizationtokens.md): Token quantities retained independently from pricing arithmetic.
- [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime.
- [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks.
- [Struct LlmSanitize Request Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmsanitizerequestcontext.md): Active codec identity and capability for an LLM request.
- [Struct LlmSanitize Response Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmsanitizeresponsecontext.md): Active codec identity and capability for an LLM response.
- [Struct LlmStream Next](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-llmstreamnext.md): Continuation handle for LLM stream execution intercepts.
- [Struct Metric Envelope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-metricenvelope.md): Payload stored in a mark using `METRIC_DATA_SCHEMA_NAME`.
- [Struct Metric Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-metricmeasurement.md): One recording operation in a Relay metric mark.
- [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner.
- [Struct Plugin Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-plugincontext.md): Registration context passed to `WorkerPlugin::register`.
- [Struct Plugin Runtime](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-pluginruntime.md): Cloneable handle for calling the Relay host runtime from worker callbacks.
- [Struct Runtime Diagnostic](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimediagnostic.md): One bounded runtime diagnostic reported by the Relay host.
- [Struct Runtime Diagnostics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimediagnostics.md): Bounded snapshot of active host runtime diagnostics.
- [Struct Runtime Registration Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimeregistrationidentity.md): Structured identity for a global gateable runtime registration.
- [Struct Runtime Registration Owner](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-runtimeregistrationowner.md): Discovery metadata describing the owner of a runtime registration.
- [Struct Tool Execution Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutioncontext.md): Per-call context supplied to a tool execution intercept.
- [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept.
- [Struct Tool Execution Result](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-toolexecutionresult.md): Canonical application-visible result of tool execution.
- [Struct Tool Next](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-toolnext.md): Continuation handle for tool execution intercepts.
- [Struct Worker Request Codec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-workerrequestcodec.md): Invocation-scoped proxy for the active LLM request codec.
- [Struct Worker Response Codec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-workerresponsecodec.md): Invocation-scoped proxy for the active LLM response codec.
- [Struct Worker Server Config](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/struct-workerserverconfig.md): Explicit worker server configuration for tests and custom launchers.
- [Enum Builtin LlmCodec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-builtinllmcodec.md): Relay's built-in LLM codec identities.
- [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-diagnosticlevel.md): Severity of a plugin configuration or activation diagnostic.
- [Enum Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime.
- [Enum LlmCodec Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-llmcodecidentity.md): Per-call LLM codec identity supplied to sanitizer and SDK callbacks.
- [Enum LlmOptimization Evidence Quality](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-llmoptimizationevidencequality.md): Whether token evidence was observed directly or estimated.
- [Enum LlmOptimization Summary Status](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-llmoptimizationsummarystatus.md): Completeness of close-time optimization accounting.
- [Enum LogSeverity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-logseverity.md): Severity attached to a mark that may be projected as an OpenTelemetry log.
- [Enum Metric Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-metrickind.md): OpenTelemetry instrument kind represented by a metric measurement mark.
- [Enum Metric Value Type](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-metricvaluetype.md): Numeric representation used by a metric measurement.
- [Enum Plugin LogLevel](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-pluginloglevel.md): Process-log severity for records emitted through the Relay host.
- [Enum Runtime Registration Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-runtimeregistrationkind.md): A global runtime registration surface that can be selected by a conditional middleware guardrail.
- [Enum Runtime Registration Owner Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-runtimeregistrationownerkind.md): The owner category reported for a global runtime registration.
- [Enum Scope Type](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-scopetype.md): Semantic category attached to a scope lifecycle span.
- [Enum Worker SdkError](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/enum-workersdkerror.md): Error returned by worker SDK callbacks and runtime helpers.
- [Constant ANNOTATED_LLM_REQUEST_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/constant-annotated-llm-request-schema.md): Versioned JSON envelope schema for `AnnotatedLlmRequest`.
- [Constant METRIC_DATA_SCHEMA_NAME](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/constant-metric-data-schema-name.md): Relay-owned schema name for mark payloads containing metric measurements.
- [Constant METRIC_DATA_SCHEMA_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/constant-metric-data-schema-version.md): Current Relay-owned metric measurement schema version.
- [Trait LlmOptimization Payload](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/trait-llmoptimizationpayload.md): Trait implemented by typed plugin payloads embedded in an optimization contribution.
- [Trait Worker Plugin](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/trait-workerplugin.md): Trait implemented by Rust out-of-process worker plugins.
- [Function serve_plugin](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin.md): Serves a worker plugin using environment variables supplied by the Relay host.
- [Function serve_plugin_arc](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin-arc.md): Serves a shared worker plugin using environment variables supplied by the Relay host.
- [Function serve_plugin_arc_with_config](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/fn-serve-plugin-arc-with-config.md): Serves a shared worker plugin using explicit endpoint and authentication configuration.
- [Type Alias BoxFuture Result](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/type-boxfutureresult.md): Boxed future returned by async worker callbacks.
- [Type Alias Json](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.
- [Type Alias Json Stream](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/type-jsonstream.md): Boxed JSON stream returned by streaming worker callbacks.
- [Type Alias LlmRequest Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/type-llmrequestcontext.md): Request codec context supplied to an LLM execution intercept.
- [Type Alias LlmResponse Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/type-llmresponsecontext.md): Response codec context supplied to an LLM execution intercept.
- [Type Alias Result](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-worker/type-result.md): SDK result type.