For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
      • Python Library Reference
      • Node.js Library Reference
      • Rust Library Reference
        • nemo-relay
        • nemo-relay-adaptive
          • acg
            • anthropic_plugin
            • canonicalize
            • capability
            • ir_builder
            • openai_plugin
            • passthrough
            • plugin
            • plugin_registry
            • policy
            • profile
            • prompt_ir
            • retention
            • stability
            • telemetry
              • CacheHitRate
              • CacheMissDiagnosis
              • CacheRequestFacts
              • CacheTelemetryEvent
              • CacheMissEvidence
              • CacheMissReason
              • CacheTelemetryProvider
            • types
            • variable_extractor
            • error
            • MIN_ACG_OBSERVATIONS
          • acg_component
          • acg_learner
          • acg_profile
          • adaptive_hints_intercept
          • cache_diagnostics
          • config
          • context_helpers
          • drain
          • error
          • intercepts
          • learner
          • plugin_component
          • redis
          • storage
          • subscriber
          • tool_parallelism_learner
          • trie
          • types
          • AdaptiveRuntime
        • nemo-relay-ffi
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • Variants
  • PrefixMismatch
  • BelowMinimumThreshold
  • RetentionExpired
  • RoutingMismatch
  • Evicted
  • UnsupportedFeature
  • ColdStart
  • Unknown
  • Other
  • Fields
  • description: String
  • Trait Implementations
  • impl Clone for CacheMissReason
  • clone
  • clone_from
  • impl Debug for CacheMissReason
  • fmt
  • impl<'de> Deserialize<'de> for CacheMissReason
  • deserialize
  • impl Hash for CacheMissReason
  • hash
  • hash_slice
  • impl PartialEq for CacheMissReason
  • eq
  • ne
  • impl Serialize for CacheMissReason
  • serialize
  • impl Eq for CacheMissReason
  • impl StructuralPartialEq for CacheMissReason
ReferenceAPIsRust Library Referencenemo-relay-adaptiveacgtelemetry

Enum Cache Miss Reason

||View as Markdown|
Previous

Enum Cache Miss Evidence

Next

Enum Cache Telemetry Provider

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub enum CacheMissReason {
    PrefixMismatch,
    BelowMinimumThreshold,
    RetentionExpired,
    RoutingMismatch,
    Evicted,
    UnsupportedFeature,
    ColdStart,
    Unknown,
    Other {
        description: String,
    },
}

Reason why a cache miss occurred.

Covers 8 determinable reasons plus an extensible Other variant. Uses internally-tagged JSON representation ("reason" field) so each variant serializes as {"reason": "snake_case"} and the Other variant additionally carries a description field.

Variants

PrefixMismatch

PrefixMismatch

Prompt prefix didn’t match cached prefix.

BelowMinimumThreshold

BelowMinimumThreshold

Stable prefix shorter than provider minimum for caching.

RetentionExpired

RetentionExpired

Cached prefix retention window elapsed.

RoutingMismatch

RoutingMismatch

Request routed to different worker/pool.

Evicted

Evicted

Cache evicted due to capacity pressure.

UnsupportedFeature

UnsupportedFeature

Backend/model doesn’t support caching.

ColdStart

ColdStart

First request for this prefix (no prior cache entry).

Unknown

Unknown

Reason could not be determined from provider response.

Other

Other

Extensible escape hatch for reasons not yet in the enum.

Fields

description: String

Human-readable description of the miss reason.

Trait Implementations

impl Clone for CacheMissReason

impl Clone for CacheMissReason

clone

fn clone(&self) -> CacheMissReason

clone_from

fn clone_from(&mut self, source: &Self)

impl Debug for CacheMissReason

impl Debug for CacheMissReason

fmt

fn fmt(&self, f: &mut Formatter<'_>) -> Result

impl<'de> Deserialize<'de> for CacheMissReason

impl<'de> Deserialize<'de> for CacheMissReason

deserialize

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

impl Hash for CacheMissReason

impl Hash for CacheMissReason

hash

fn hash<__H: Hasher>(&self, state: &mut __H)

hash_slice

fn hash_slice<H>(data: &[Self], state: &mut H)where
    H: Hasher,
    Self: Sized,

impl PartialEq for CacheMissReason

impl PartialEq for CacheMissReason

eq

fn eq(&self, other: &CacheMissReason) -> bool

ne

fn ne(&self, other: &Rhs) -> bool

impl Serialize for CacheMissReason

impl Serialize for CacheMissReason

serialize

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

impl Eq for CacheMissReason

impl Eq for CacheMissReason

impl StructuralPartialEq for CacheMissReason

impl StructuralPartialEq for CacheMissReason