Module config

This page is for NeMo Relay, version dev. For other versions, use one of these documentation indexes: - Latest (v0.11.1) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt - v0.11.1: https://docs.nvidia.com/nemo/relay/v0.11.1/llms.txt - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Collection settings and measurement units.

Structs

• ResourceMemoryInspectionConfig: Read-only latest memory projection. Does not enable polling or collection.
• ResourceMetricsConfig: Configuration for the built-in resource_metrics plugin component.
• ResourceMetricsCpuConfig: CPU observations, limits, and pressure.
• ResourceMetricsCpuUnits: CPU measurement unit choices.
• ResourceMetricsDiskConfig: Disk I/O for the selected process scope and filesystem capacity.
• ResourceMetricsDiskUnits: Disk measurement unit choices.
• ResourceMetricsGpuConfig: Accelerator observations.
• ResourceMetricsGpuUnits: GPU measurement unit choices.
• ResourceMetricsMemoryConfig: Memory observations, limits, pressure, and OOM events.
• ResourceMetricsMemoryUnits: Memory measurement unit choices.
• ResourceMetricsNetworkConfig: System interface counters. Empty interfaces selects every visible interface.
• ResourceMetricsNetworkTrafficUnits: Unit choices for one group of network traffic.
• ResourceMetricsNetworkUnits: Unit choices for system and interface traffic.
• ResourceMetricsPollingConfig: Periodic collection controlled by the resource_metrics plugin component.
• ResourceMetricsProcessConfig: Process, thread, handle, descriptor, and process-limit observations.
• ResourceMetricsUnits: Output unit choices for resource metrics.

Enums

• BandwidthUnit: Units for data transferred per second.
• CapacityUnit: Units for memory and filesystem capacity.
• CpuUnit: Units for CPU consumption and effective capacity.
• DataUnit: Units for cumulative transferred data.
• DurationUnit: Units for elapsed and cumulative durations.
• ResourceMetricsMeasurementScope: Measurement boundary selected for resource metric collection.
• UtilizationUnit: Units for GPU compute utilization.