Struct Cache Request Facts | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub struct CacheRequestFacts {
    pub provider: String,
    pub stable_prefix_length: usize,
    pub stable_prefix_tokens: Option<u32>,
    pub required_min_tokens: Option<u32>,
    pub first_mismatch_span_id: Option<String>,
    pub first_mismatch_sequence_index: Option<u32>,
    pub expected_hash_prefix: Option<String>,
    pub actual_hash_prefix: Option<String>,
    pub retention_window_secs: Option<f64>,
    pub observed_gap_secs: Option<f64>,
    pub missing_facts: Vec<String>,
}

Request-time facts used to classify a cache miss without leaking prompt text.

Fields

`provider: String`

Canonical provider string associated with the request facts.

`stable_prefix_length: usize`

Number of stable prefix blocks observed in the request.

`stable_prefix_tokens: Option<u32>`

Token count for the stable prefix when it can be measured safely.

`required_min_tokens: Option<u32>`

Minimum provider threshold required for cache reuse.

`first_mismatch_span_id: Option<String>`

Span ID of the first stable block that mismatched the retained exemplar.

`first_mismatch_sequence_index: Option<u32>`

Sequence index of the first mismatching stable block.

`expected_hash_prefix: Option<String>`

Expected short SHA-256 hash prefix for the first mismatching block.

`actual_hash_prefix: Option<String>`

Actual short SHA-256 hash prefix for the first mismatching block.

`retention_window_secs: Option<f64>`

Active cache retention window in seconds when provider semantics expose one.

`observed_gap_secs: Option<f64>`

Observed elapsed time since the same stable prefix was last seen.

`missing_facts: Vec<String>`

Facts that were unavailable when the runtime attempted diagnosis.

Trait Implementations

`impl Clone for CacheRequestFacts`

impl Clone for CacheRequestFacts

`clone`

fn clone(&self) -> CacheRequestFacts

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for CacheRequestFacts`

impl Debug for CacheRequestFacts

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl<'de> Deserialize<'de> for CacheRequestFacts`

impl<'de> Deserialize<'de> for CacheRequestFacts

`deserialize`

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

`impl PartialEq for CacheRequestFacts`

impl PartialEq for CacheRequestFacts

`eq`

fn eq(&self, other: &CacheRequestFacts) -> bool

`ne`

fn ne(&self, other: &Rhs) -> bool

`impl Serialize for CacheRequestFacts`

impl Serialize for CacheRequestFacts

`serialize`

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

`impl StructuralPartialEq for CacheRequestFacts`

impl StructuralPartialEq for CacheRequestFacts