Module telemetry

This page is for NeMo Relay, version dev. For other versions, use one of these documentation indexes: - Latest (v0.11.1) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt - v0.11.1: https://docs.nvidia.com/nemo/relay/v0.11.1/llms.txt - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Cache performance telemetry types for the Adaptive Cache Governor (ACG) system.

These types normalize provider-specific cache metrics (Anthropic cache_read_input_tokens/cache_creation_input_tokens, OpenAI cached_tokens) into a common schema for uniform measurement. Populated by provider-specific normalization logic in Phase 9.

Structs

• CacheHitRate: Aggregated cache hit rate over a time window.
• CacheMissDiagnosis: Structured diagnosis for a cache miss.
• CacheRequestFacts: Request-time facts used to classify a cache miss without leaking prompt text.
• CacheTelemetryEvent: Per-call cache telemetry event.

Enums

• CacheMissEvidence: Typed evidence for a cache miss diagnosis.
• CacheMissReason: Reason why a cache miss occurred.
• CacheTelemetryProvider: Cache telemetry provider identity for canonical Usage normalization.