Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.
Cache performance telemetry types for the Adaptive Cache Governor (ACG) system.
These types normalize provider-specific cache metrics (Anthropic cache_read_input_tokens/cache_creation_input_tokens, OpenAI cached_tokens) into a common schema for uniform measurement. Populated by provider-specific normalization logic in Phase 9.
Structs
- CacheHitRate: Aggregated cache hit rate over a time window.
- CacheMissDiagnosis: Structured diagnosis for a cache miss.
- CacheRequestFacts: Request-time facts used to classify a cache miss without leaking prompt text.
- CacheTelemetryEvent: Per-call cache telemetry event.
Enums
- CacheMissEvidence: Typed evidence for a cache miss diagnosis.
- CacheMissReason: Reason why a cache miss occurred.
- CacheTelemetryProvider: Cache telemetry provider identity for canonical
Usage normalization.
