Enum Token Rate Schedule | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub enum TokenRateSchedule {
    PromptTokenThreshold {
        applies_to: RateScheduleApplication,
        tiers: Vec<TokenRateTier>,
    },
}

Data-driven token rate schedule for provider pricing with request thresholds.

Variants

PromptTokenThreshold

Selects one full-request rate tier based on prompt/input tokens.

How selected tier rates apply to tokens.

Ordered threshold tiers.

impl Clone for TokenRateSchedule

fn clone(&self) -> TokenRateSchedule

fn clone_from(&mut self, source: &Self)

impl Debug for TokenRateSchedule

fn fmt(&self, f: &mut Formatter<'_>) -> Result

impl<'de> Deserialize<'de> for TokenRateSchedule

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

impl PartialEq for TokenRateSchedule

fn eq(&self, other: &TokenRateSchedule) -> bool

fn ne(&self, other: &Rhs) -> bool

impl Serialize for TokenRateSchedule

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

impl StructuralPartialEq for TokenRateSchedule