Module manager

This page is for NeMo Relay, version dev. For other versions, use one of these documentation indexes: - Latest (v0.11.1) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt - v0.11.1: https://docs.nvidia.com/nemo/relay/v0.11.1/llms.txt - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Sampling ownership and polling lifecycle. Process resource collection, sampling ownership, and polling lifecycle.

Structs

• ResourceMetricsRuntime: Owns the optional resource metrics polling thread for a built-in plugin activation.

Functions

• collect_on_demand
• ensure_process_owner
• invalidated_snapshot
• latest_memory_view: Read an existing manager only. Inspection must not resolve settings, start a manager, collect, or retarget it. Fork checks precede every potentially inherited lock.
• prepare_cli_owned_process_tree
• runtime_inherited_across_fork
• target_owned_process_tree

Type Aliases

• SnapshotSink: Receives each periodic resource snapshot.