Module embedded

This page is for NeMo Relay, version dev. For other versions, use one of these documentation indexes: - Latest (v0.10.4) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt - v0.11.0: https://docs.nvidia.com/nemo/relay/v0.11.0/llms.txt - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Configuration-driven service and bounded copies for embedded language runtimes. Configuration-driven embedded service and bounded language-adapter copies.

Readers are inspection authority. No automatic formatting or error path exposes retained detail, and no snapshot is connected to an event/exporter pipeline.

Structs

• EmbeddedDiagnosticInfo: Independent budgets and coverage of the binding adapter; excludes language object overhead and caller-retained copies, and is not an RSS measurement.
• EmbeddedDiagnosticPage: Adapter-owned page payload. Its permit is returned deterministically on drop. Foreign results are caller-owned copies and must never retain this object.
• EmbeddedDiagnosticsReader: Read-only embedded capability. Clones share the service’s copy admission pool. Debug output deliberately contains no snapshot, query, or restricted detail.

Enums

• EmbeddedDiagnosticError: Stable service/reader failure. Messages never contain retained evidence or query input.

Constants

• BINDING_COPY_CONCURRENCY: Independent simultaneous page-copy/foreign-conversion budget per service.
• DIAGNOSTIC_QUERY_INTEGER_FIELDS: Query fields whose canonical JSON value is a lossless unsigned integer. Binding adapters use this descriptor when accepting native integer inputs.
• MAX_BINDING_QUERY_BYTES: Maximum encoded query accepted by an embedded reader, before JSON parsing.

Functions

• decode_query: Decode bounded input without copying an unbounded foreign query graph.
• reader: Obtain an inspection capability without initializing the service or logger. The service is selected by ordinary plugin-host initialization configuration.