> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server. # nemo-relay-types > Shared serializable data model types for NeMo Relay. Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`. Shared serializable data model types for NeMo Relay. This crate contains DTOs and wire-compatible type definitions used by the runtime and native plugin SDK. It intentionally does not contain runtime registries, dynamic loading, codecs, exporters, or process-global state. ## Modules * [api](/reference/api/rust-library-reference/nemo-relay-types/api): Public runtime API data types. Shared API data types. * [codec](/reference/api/rust-library-reference/nemo-relay-types/codec): Normalized LLM request and response data types. Shared normalized LLM request and response data types. * [diagnostics](/reference/api/rust-library-reference/nemo-relay-types/diagnostics): Versioned, transport-neutral runtime diagnostic contracts. Portable diagnostic evidence shared by Relay runtimes, tools, and adapters. * [plugin](/reference/api/rust-library-reference/nemo-relay-types/plugin): Plugin configuration diagnostic data types. Shared plugin diagnostic data types. ## Type Aliases * [Json](/reference/api/rust-library-reference/nemo-relay-types/type-json): Type alias for [`serde_json::Value`](https://docs.rs/serde_json/1.0.149/serde_json/value/enum.Value.html), used as the universal JSON representation throughout NeMo Relay APIs. > Shared serializable data model types for NeMo Relay. ## Docs - [Module api](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api.md): Public runtime API data types. Shared API data types. - [Module event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event.md): Lifecycle event DTOs. Event types for Agent Trajectory Observability Format (ATOF) runtime events. - [Struct Base Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-baseevent.md): Shared event metadata carried by every ATOF event. - [Struct Category Profile](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-categoryprofile.md): Category-specific profile data. - [Struct Data Schema](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-dataschema.md): Identifier for the schema that describes an event's opaque `data` payload. - [Struct Event Category](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-eventcategory.md): Semantic category carried by ATOF `category`. - [Struct Event Sanitize Fields](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-eventsanitizefields.md): Observability fields that event sanitizers may rewrite. - [Struct Finite F64](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-finitef64.md): A finite IEEE 754 double-precision value. - [Struct Histogram Boundaries](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-histogramboundaries.md): Explicit histogram bucket boundaries that are finite and strictly increasing. - [Struct Instrument Descriptor](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-instrumentdescriptor.md): Descriptor fields shared by all recordings of an instrument. - [Struct Instrument Name](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-instrumentname.md): An OpenTelemetry instrument name together with its canonical form. - [Struct Mark Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-markevent.md): ATOF point-in-time mark event. - [Struct Metric Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-metricattributes.md): A deterministic map of typed OpenTelemetry metric attributes. - [Struct Metric Envelope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-metricenvelope.md): Payload stored in a mark using `METRIC_DATA_SCHEMA_NAME`. - [Struct Metric Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-metricmeasurement.md): One recording operation in a Relay metric mark. - [Struct Metric Validation Error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-metricvalidationerror.md): Validation error for a Relay metric envelope. - [Struct Parse LogSeverity Error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-parselogseverityerror.md): Error returned when parsing an unsupported log severity. - [Struct Pending Mark Spec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-pendingmarkspec.md): Mark requested by middleware for materialization by a lifecycle owner. - [Struct Scope Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-scopeevent.md): ATOF scope lifecycle event. - [Struct Validated Metric Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/struct-validatedmetricmeasurement.md): Parsed metric measurement that is safe for OTLP export. - [Enum Attribute Value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-attributevalue.md): Typed OpenTelemetry attribute values, including homogeneous primitive arrays. - [Enum Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-event.md): Tagged union covering the two ATOF event kinds emitted by the runtime. - [Enum LogSeverity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-logseverity.md): Severity attached to a mark that may be projected as an OpenTelemetry log. - [Enum Metric Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-metrickind.md): OpenTelemetry instrument kind represented by a metric measurement mark. - [Enum Metric Value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-metricvalue.md): One typed metric value accepted by Relay's metric schema. - [Enum Metric Value Type](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-metricvaluetype.md): Numeric representation used by a metric measurement. - [Enum Scope Category](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/enum-scopecategory.md): Agent Trajectory Observability Format (ATOF) lifecycle phase for a scope event. - [Constant ATOF_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/constant-atof-version.md): Agent Trajectory Observability Format (ATOF) protocol version emitted by this runtime. - [Constant LOG_SEVERITY_METADATA_KEY](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/constant-log-severity-metadata-key.md): Reserved metadata key carrying the canonical severity of a mark exported as a log. - [Constant METRIC_DATA_SCHEMA_NAME](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/constant-metric-data-schema-name.md): Relay-owned schema name for mark payloads containing metric measurements. - [Constant METRIC_DATA_SCHEMA_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/constant-metric-data-schema-version.md): Current Relay-owned metric measurement schema version. - [Function attributes_from_handle](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-attributes-from-handle.md): Convert handle bitflags into ATOF attributes. - [Function llm_attributes_to_strings](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-llm-attributes-to-strings.md): Convert LLM bitflags into ATOF attributes. - [Function scope_attributes_to_strings](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-scope-attributes-to-strings.md): Convert scope bitflags into ATOF attributes. - [Function tool_attributes_to_strings](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-tool-attributes-to-strings.md): Convert tool bitflags into ATOF attributes. - [Function validate_metric_measurements](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/event/fn-validate-metric-measurements.md): Validate a complete list of metric measurements atomically. - [Module llm](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/llm.md): LLM DTOs and attributes. Shared LLM data types. - [Struct LlmAttributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmattributes.md): Bitflags that modify LLM-call behavior and observability. - [Struct LlmRequest](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequest.md): JSON-shaped LLM request payload passed through the runtime. - [Struct LlmRequest Intercept Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/llm/struct-llmrequestinterceptoutcome.md): Result of an LLM request intercept that can schedule lifecycle marks. - [Constant LLM_REQUEST_INTERCEPT_OUTCOME_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/llm/constant-llm-request-intercept-outcome-schema.md): Versioned JSON envelope schema for `LlmRequestInterceptOutcome`. - [Module registry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/registry.md): Runtime-registration discovery DTOs. Shared runtime-registration discovery data types. - [Struct Runtime Registration Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/registry/struct-runtimeregistrationidentity.md): Structured identity for a global gateable runtime registration. - [Struct Runtime Registration Owner](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/registry/struct-runtimeregistrationowner.md): Discovery metadata describing the owner of a runtime registration. - [Enum Runtime Registration Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/registry/enum-runtimeregistrationkind.md): A global runtime registration surface that can be selected by a conditional middleware guardrail. - [Enum Runtime Registration Owner Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/registry/enum-runtimeregistrationownerkind.md): The owner category reported for a global runtime registration. - [Module resource_metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics.md): Structured system resource metric snapshots. Structured system resource metric snapshot types. - [Struct Accelerator Device Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-acceleratordevicemetrics.md): Device-wide accelerator measurements. - [Struct Accelerator Process Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-acceleratorprocessmetrics.md): Accelerator measurements attributed to one process in the selected scope. - [Struct CpuMetrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-cpumetrics.md): CPU measurements and CPU limit events. - [Struct Disk Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-diskmetrics.md): Disk I/O for the measured process scope and filesystem capacity. - [Struct Filesystem Capacity Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-filesystemcapacitymetrics.md): Filesystem capacity for one configured path. - [Struct GpuMetrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-gpumetrics.md): Accelerator (GPU) device-wide and process-attributed measurements. - [Struct Memory Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-memorymetrics.md): Memory measurements and memory limit events. - [Struct Network Interface Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-networkinterfacemetrics.md): Network traffic for one visible interface. - [Struct Network Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-networkmetrics.md): System-wide network traffic, regardless of the process measurement scope. - [Struct Network Traffic Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-networktrafficmetrics.md): Network counters for one interface or the selected system aggregate. - [Struct Process Metrics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-processmetrics.md): Process counts, process limits, handles, and descriptors. - [Struct Process Sampling Metadata](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-processsamplingmetadata.md): Coverage of process queries used for process-summed measurements. - [Struct Resource Limit Event Count](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-resourcelimiteventcount.md): One typed cumulative resource-limit event counter. - [Struct Resource Measurement](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-resourcemeasurement.md): One available resource measurement. - [Struct Resource Metrics Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/struct-resourcemetricssnapshot.md): One point-in-time observation of the selected system and process resources. - [Enum Accelerator Vendor](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-acceleratorvendor.md): Accelerator vendor associated with a metric record. - [Enum Bandwidth Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-bandwidthunit.md): Units for data transferred per second. - [Enum Capacity Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-capacityunit.md): Units for memory and filesystem capacity. - [Enum Count Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-countunit.md): Fixed units for process, resource, and operation counts. - [Enum CpuUnit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-cpuunit.md): Units for CPU consumption and effective capacity. - [Enum Data Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-dataunit.md): Units for cumulative transferred data. - [Enum Duration Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-durationunit.md): Units for elapsed and cumulative durations. - [Enum Resource Limit Event Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-resourcelimiteventkind.md): Direct operating-system resource-limit event kind. - [Enum Resource Limit Resource](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-resourcelimitresource.md): Resource whose configured boundary produced a limit event. - [Enum Resource Measurement Scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-resourcemeasurementscope.md): System or process boundary measured by a snapshot. - [Enum Resource Metric Value](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-resourcemetricvalue.md): Exact integral values remain integers; converted fractional values are decimals. - [Enum Resource Operating System](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-resourceoperatingsystem.md): Operating system that produced a resource metrics snapshot. - [Enum Utilization Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/enum-utilizationunit.md): Units for GPU compute utilization. - [Trait Resource Unit](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/resource_metrics/trait-resourceunit.md): A unit with a stable name in snapshots and metric marks. - [Module scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/scope.md): Scope DTOs and attributes. Shared scope data types. - [Struct Scope Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/scope/struct-scopeattributes.md): Bitflags that modify scope behavior and observability. - [Struct Scope Stack Entry](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/scope/struct-scopestackentry.md): Identity of one entry in the visible Relay scope stack. - [Struct Scope Stack Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/scope/struct-scopestacksnapshot.md): Owned root-to-top values from one coherent read of a visible scope stack. - [Enum Handle Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/scope/enum-handleattributes.md): Attribute bitflags attached to a concrete handle kind. - [Enum Scope Type](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/scope/enum-scopetype.md): Semantic category attached to a scope lifecycle span. - [Module tool](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/tool.md): Tool DTOs and attributes. Shared tool data types. - [Struct Tool Attributes](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/tool/struct-toolattributes.md): Bitflags that modify tool-call behavior and observability. - [Struct Tool Execution Intercept Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/tool/struct-toolexecutioninterceptoutcome.md): Canonical result returned by a tool execution intercept. - [Struct Tool Execution Result](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/tool/struct-toolexecutionresult.md): Canonical application-visible result of tool execution. - [Constant TOOL_EXECUTION_INTERCEPT_OUTCOME_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/tool/constant-tool-execution-intercept-outcome-schema.md): Versioned native-plugin JSON envelope schema for `ToolExecutionInterceptOutcome`. - [Constant TOOL_EXECUTION_RESULT_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/api/tool/constant-tool-execution-result-schema.md): Versioned native-plugin JSON envelope schema for `ToolExecutionResult`. - [Module codec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec.md): Normalized LLM request and response data types. Shared normalized LLM request and response data types. - [Module identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/identity.md): Stable LLM codec identities shared across SDK boundaries. Stable LLM codec identities shared across Relay runtime and SDK boundaries. - [Enum Builtin LlmCodec](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/identity/enum-builtinllmcodec.md): Relay's built-in LLM codec identities. - [Enum LlmCodec Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/identity/enum-llmcodecidentity.md): Per-call LLM codec identity supplied to sanitizer and SDK callbacks. - [Module optimization](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization.md): Plugin-neutral LLM optimization evidence and summaries. Plugin-neutral evidence and summaries for LLM optimizations. - [Struct LlmOptimization Contribution](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationcontribution.md): One optimizer's evidence for a change to an LLM call. - [Struct LlmOptimization Kind](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationkind.md): Open, forward-compatible optimization classification. - [Struct LlmOptimization Model](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationmodel.md): Model identity used for counterfactual and effective pricing. - [Struct LlmOptimization Model Transition](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationmodeltransition.md): A model change proposed or applied by an optimizer. - [Struct LlmOptimization Summary](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationsummary.md): Close-time accounting attached to the normalized LLM response. - [Struct LlmOptimization Token Impact](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationtokenimpact.md): Shared token evidence that Relay can aggregate without understanding a plugin payload. - [Struct LlmOptimization Tokens](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/struct-llmoptimizationtokens.md): Token quantities retained independently from pricing arithmetic. - [Enum LlmOptimization Evidence Quality](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/enum-llmoptimizationevidencequality.md): Whether token evidence was observed directly or estimated. - [Enum LlmOptimization Summary Status](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/enum-llmoptimizationsummarystatus.md): Completeness of close-time optimization accounting. - [Trait LlmOptimization Payload](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/optimization/trait-llmoptimizationpayload.md): Trait implemented by typed plugin payloads embedded in an optimization contribution. - [Module request](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request.md): Normalized LLM request data types. LLM request codec types and trait. - [Struct Annotated LlmRequest](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-annotatedllmrequest.md): Structured view of an LLM request, produced by a Codec from opaque `LlmRequest` content. - [Struct Function Call](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-functioncall.md): A function call within a tool call. - [Struct Function Definition](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-functiondefinition.md): A function definition within a tool definition. - [Struct Generation Params](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-generationparams.md): Normalized generation parameters across providers. - [Struct Open AiImage Url](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-openaiimageurl.md): OpenAI image URL payload. - [Struct Provider Native Component](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-providernativecomponent.md): Lossless provider-native component embedded in the annotated request. - [Struct Tool Call](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-toolcall.md): A tool call requested by the assistant. - [Struct Tool Choice Function](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-toolchoicefunction.md): A specific tool choice that forces a named function. - [Struct Tool Choice Function Name](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/struct-toolchoicefunctionname.md): The name component of a specific tool choice. - [Enum ApiSpecific Request](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-apispecificrequest.md): API-specific request fields that do not have portable semantics. - [Enum Content Part](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-contentpart.md): A single content part within a multimodal message. - [Enum Message](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-message.md): A single message in a conversation, tagged by role. - [Enum Message Content](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-messagecontent.md): Message content: either a plain string or multimodal parts array. - [Enum Tool Choice](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-toolchoice.md): Tool choice control: how the model should use available tools. - [Enum Tool Definition](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/enum-tooldefinition.md): A tool definition available to the model. - [Constant ANNOTATED_LLM_REQUEST_SCHEMA](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/request/constant-annotated-llm-request-schema.md): Versioned JSON envelope schema for `AnnotatedLlmRequest`. - [Module response](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response.md): Normalized LLM response data types. Normalized LLM response types produced by response codecs. - [Struct Annotated LlmResponse](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-annotatedllmresponse.md): Structured view of an LLM response, produced by a response codec from raw JSON API output. - [Struct Cost Estimate](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-costestimate.md): Normalized LLM response cost. - [Struct Response Tool Call](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-responsetoolcall.md): A tool call requested by the model in its response. - [Struct Usage](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/struct-usage.md): Token usage statistics from an LLM API response. - [Enum ApiSpecific Response](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/enum-apispecificresponse.md): API-specific response data that cannot be normalized across providers. - [Enum Cost Source](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/enum-costsource.md): Source of a normalized cost value. - [Enum Finish Reason](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/codec/response/enum-finishreason.md): Normalized reason why the model stopped generating. - [Module diagnostics](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics.md): Versioned, transport-neutral runtime diagnostic contracts. Portable diagnostic evidence shared by Relay runtimes, tools, and adapters. - [Struct Classification](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-classification.md): Shared classification payload for producers, projections, and decoded evidence. - [Struct Classification Error](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-classificationerror.md): A cause is missing, forbidden, or unsupported by the selected catalogue code. - [Struct Component Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-componentidentity.md): Identity of one registered component within a diagnostic source. - [Struct Component Ownership](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-componentownership.md): Bounded attribution for a component refresh or an originating observation. - [Struct Component Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-componentsnapshot.md): One retained row per component registration instance. - [Struct Diagnostic Capability](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticcapability.md): Capability coverage, including explicitly deferred producer integrations. - [Struct Diagnostic Correlation](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticcorrelation.md): Optional caller correlation identifiers, excluded from aggregation keys. - [Struct Diagnostic Count](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticcount.md): Magnitude of an occurrence or loss counter, including overflow visibility. - [Struct Diagnostic Counter](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticcounter.md): Lifetime occurrences for one code in its containing component instance. - [Struct Diagnostic Coverage](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticcoverage.md): Explicit evidence, retention, saturation, and producer integration coverage. - [Struct Diagnostic Cursor](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticcursor.md): Opaque continuation bound to source, capture revision, offsets, and scope. - [Struct Diagnostic Detail](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticdetail.md): Restricted optional recent evidence, independent of the accepted numeric summary. - [Struct Diagnostic Discovery](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticdiscovery.md): Side-effect-free discovery, available even when snapshot queries are disabled. - [Struct Diagnostic Event](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticevent.md): One recent observation with its actual class and original configuration attribution. - [Struct Diagnostic Lifetime Summary](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticlifetimesummary.md): Fixed lifetime totals and monotonic timing for a context or component instance. - [Struct Diagnostic Loss](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticloss.md): Source loss state reserved independently of optional evidence capacity. - [Struct Diagnostic Number](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticnumber.md): Unsigned diagnostic integer serialized losslessly as a decimal string. - [Struct Diagnostic Origin](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticorigin.md): Original bounded configuration attribution carried by one observation. - [Struct Diagnostic Output Summary](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticoutputsummary.md): Allowlisted operational output, constructed independently of retained detail. - [Struct Diagnostic Query](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticquery.md): Portable bounded selection; consumers never reset or mutate evidence. - [Struct Diagnostic Refresh Summary](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticrefreshsummary.md): One current resettable counting period, with no retained historical summary. - [Struct Diagnostic Retention](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticretention.md): Boundaries of returned retained evidence, separate from cumulative counters. - [Struct Diagnostic Snapshot](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticsnapshot.md): Read evidence from one source incarnation, using the canonical snapshot schema. - [Struct Diagnostic Totals](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnostictotals.md): Fixed numeric accounting for one explicitly identified lifetime or refresh scope. - [Struct Diagnostic Window](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticwindow.md): Fixed-resolution outcome series for the containing component instance. - [Struct Diagnostic Window Bucket](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticwindowbucket.md): An aggregate bucket using component-relative elapsed time, never raw process ticks. - [Struct Diagnostic Window Coverage](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-diagnosticwindowcoverage.md): Actual observation interval and limitations of a fixed-bucket window. - [Struct Plugin Execution Name](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-pluginexecutionname.md): A plugin execution mechanism name, preserving values unknown to this reader. Typed conversion accepts only the corresponding catalogue enum. - [Struct Plugin Observation Context](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-pluginobservationcontext.md): Shared plugin-operation facts for producers, projections, and decoded evidence. - [Struct Plugin Phase Name](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-pluginphasename.md): A plugin lifecycle phase name, preserving values unknown to this reader. Typed conversion accepts only the corresponding catalogue enum. - [Struct Remote Diagnostic Origin](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-remotediagnosticorigin.md): Fixed-size provenance retained by an authorized ingestion adapter. - [Struct Source Identity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/struct-sourceidentity.md): Identity of one Relay process or explicitly owned runtime incarnation. - [Enum Builtin Diagnostic Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-builtindiagnosticcode.md): Fixed-size canonical authoring value with one authoritative hierarchy. - [Enum CliFailure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-clifailurecode.md): Failures at integrated CLI operation boundaries; causes come from producers. - [Enum Common Plugin Failure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-commonpluginfailurecode.md): Plugin failures supported by phase-one activation recording. - [Enum Daemon Failure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-daemonfailurecode.md): Failures observed by daemon operation owners, independent of health policy. - [Enum Diagnostic Availability](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-diagnosticavailability.md): Availability of evidence, without applying deployment or application health. - [Enum Diagnostic Domain](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-diagnosticdomain.md): Top-level owning subsystem, derived from its catalogue code. - [Enum Diagnostic Outcome](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-diagnosticoutcome.md): Observed operation outcome; severity does not imply this value. - [Enum Diagnostic Severity](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-diagnosticseverity.md): Severity of evidence, independent of an operation's outcome. - [Enum Diagnostic Summary Scope](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-diagnosticsummaryscope.md): Scope of summary and outcome-window values in a filtered response. - [Enum Failure Class](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-failureclass.md): Supported general cause, independent of health, retries, and operation outcome. - [Enum Failure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-failurecode.md): Failure event hierarchy for integrated producers. - [Enum Logging Failure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-loggingfailurecode.md): Initial Logging failure vocabulary. - [Enum Notice Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-noticecode.md): Bounded non-failure observations; they never acquire a failure class. - [Enum Plugin Diagnostic Family](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-plugindiagnosticfamily.md): Semantic family of related plugin diagnostic codes. - [Enum Plugin Execution](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-pluginexecution.md): Producer-authored plugin execution mechanism, excluded from counter identity. - [Enum Plugin Failure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-pluginfailurecode.md): Plugin failure hierarchy for integrated producers. - [Enum Plugin Operation Failure Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-pluginoperationfailurecode.md): Failures at observed dynamic-plugin operation boundaries. - [Enum Plugin Phase](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-pluginphase.md): Observed plugin lifecycle phase or policy-gate context, independent of classification. - [Enum Success Code](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/enum-successcode.md): Explicit successful operations; successes do not recover or clear failures. - [Constant DIAGNOSTIC_CATALOGUE_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/constant-diagnostic-catalogue-version.md): Stable typed-catalogue revision, independent of the envelope version. - [Constant DIAGNOSTIC_SCHEMA_VERSION](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/constant-diagnostic-schema-version.md): Initial version of the canonical diagnostic snapshot envelope. - [Trait Diagnostic Classifier](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/trait-diagnosticclassifier.md): Pure producer behavior: borrow original evidence and return shared classification metadata. - [Type Alias Observation Time](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/diagnostics/type-observationtime.md): UTC wall-clock time when the source observed evidence or captured a snapshot. - [Module plugin](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/plugin.md): Plugin configuration diagnostic data types. Shared plugin diagnostic data types. - [Struct Config Diagnostic](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/plugin/struct-configdiagnostic.md): Structured diagnostic reported while validating or activating plugin configuration. - [Enum Diagnostic Level](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/plugin/enum-diagnosticlevel.md): Severity of a plugin configuration or activation diagnostic. - [Function http_error_message](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/plugin/fn-http-error-message.md): Formats an upstream HTTP error for transport through string-based plugin callbacks. - [Function parse_http_error_message](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/plugin/fn-parse-http-error-message.md): Reads the exact HTTP error prefix, leaving the diagnostic message unchanged. - [Type Alias Json](https://docs.nvidia.com/nemo/relay/dev/reference/api/rust-library-reference/nemo-relay-types/type-json.md): Type alias for `serde_json::Value`, used as the universal JSON representation throughout NeMo Relay APIs.