Struct Node Accumulators | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub struct NodeAccumulators {
    pub remaining_calls: HashMap<u32, RunningStats>,
    pub interarrival_ms: HashMap<u32, RunningStats>,
    pub output_tokens: HashMap<u32, RunningStats>,
    pub sensitivity: HashMap<u32, RunningStats>,
    pub all_remaining_calls: RunningStats,
    pub all_interarrival_ms: RunningStats,
    pub all_output_tokens: RunningStats,
    pub all_sensitivity: RunningStats,
}

Per-node accumulators for all metric types, keyed by call index.

Mirrors NAT’s _NodeAccumulators structure but uses streaming RunningStats instead of batch MetricsAccumulator.

Fields

`remaining_calls: HashMap<u32, RunningStats>`

Remaining-calls stats per call index.

`interarrival_ms: HashMap<u32, RunningStats>`

Interarrival-time stats per call index.

`output_tokens: HashMap<u32, RunningStats>`

Output-tokens stats per call index.

`sensitivity: HashMap<u32, RunningStats>`

Sensitivity stats per call index.

`all_remaining_calls: RunningStats`

Aggregated remaining-calls stats across all call indices.

`all_interarrival_ms: RunningStats`

Aggregated interarrival-time stats across all call indices.

`all_output_tokens: RunningStats`

Aggregated output-tokens stats across all call indices.

`all_sensitivity: RunningStats`

Aggregated sensitivity stats across all call indices.

Trait Implementations

`impl Clone for NodeAccumulators`

impl Clone for NodeAccumulators

`clone`

fn clone(&self) -> NodeAccumulators

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for NodeAccumulators`

impl Debug for NodeAccumulators

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl Default for NodeAccumulators`

impl Default for NodeAccumulators

`default`

fn default() -> NodeAccumulators

`impl<'de> Deserialize<'de> for NodeAccumulators`

impl<'de> Deserialize<'de> for NodeAccumulators

`deserialize`

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

`impl Serialize for NodeAccumulators`

impl Serialize for NodeAccumulators

`serialize`

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,