Enum Cache Miss Evidence | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub enum CacheMissEvidence {
    PrefixMismatch {
        first_mismatch_span_id: String,
        sequence_index: u32,
        expected_hash_prefix: String,
        actual_hash_prefix: String,
    },
    BelowMinimumThreshold {
        observed_prefix_tokens: u32,
        required_min_tokens: u32,
        estimation_source: String,
    },
    RetentionExpired {
        observed_gap_secs: f64,
        retention_window_secs: f64,
        provider_semantics: String,
    },
    Unknown {
        missing_facts: Vec<String>,
    },
}

Typed evidence for a cache miss diagnosis.

Variants

`PrefixMismatch`

PrefixMismatch

Stable prefix diverged from the retained exemplar.

Fields

`first_mismatch_span_id: String`

Span ID of the first mismatching stable block.

`sequence_index: u32`

Zero-based sequence index of the mismatching block.

`expected_hash_prefix: String`

Expected short SHA-256 hash prefix.

`actual_hash_prefix: String`

Actual short SHA-256 hash prefix.

`BelowMinimumThreshold`

BelowMinimumThreshold

Stable prefix is too short for provider cache reuse.

Fields

`observed_prefix_tokens: u32`

Observed stable prefix tokens.

`required_min_tokens: u32`

Required minimum tokens for cache reuse.

`estimation_source: String`

Source of the token estimate.

`RetentionExpired`

RetentionExpired

Stable prefix likely aged out of the provider retention window.

Fields

`observed_gap_secs: f64`

Observed gap between requests with the same stable prefix.

`retention_window_secs: f64`

Provider retention window in seconds.

`provider_semantics: String`

Human-readable provider semantics summary.

`Unknown`

Unknown

Diagnosis could not be justified from the available facts.

Fields

`missing_facts: Vec<String>`

List of facts that were unavailable at classification time.

Trait Implementations

`impl Clone for CacheMissEvidence`

impl Clone for CacheMissEvidence

`clone`

fn clone(&self) -> CacheMissEvidence

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for CacheMissEvidence`

impl Debug for CacheMissEvidence

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl<'de> Deserialize<'de> for CacheMissEvidence`

impl<'de> Deserialize<'de> for CacheMissEvidence

`deserialize`

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

`impl PartialEq for CacheMissEvidence`

impl PartialEq for CacheMissEvidence

`eq`

fn eq(&self, other: &CacheMissEvidence) -> bool

`ne`

fn ne(&self, other: &Rhs) -> bool

`impl Serialize for CacheMissEvidence`

impl Serialize for CacheMissEvidence

`serialize`

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

`impl StructuralPartialEq for CacheMissEvidence`

impl StructuralPartialEq for CacheMissEvidence