Struct LlmOptimization Tokens

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmOptimizationTokens {
    pub prompt_tokens: Option<u64>,
    pub completion_tokens: Option<u64>,
    pub cache_read_tokens: Option<u64>,
    pub cache_write_tokens: Option<u64>,
    pub total_tokens: Option<u64>,
}

Token quantities retained independently from pricing arithmetic.

Fields

`prompt_tokens: Option<u64>`

Input/prompt tokens.

`completion_tokens: Option<u64>`

Output/completion tokens.

`cache_read_tokens: Option<u64>`

Tokens read from a provider prompt cache.

`cache_write_tokens: Option<u64>`

Tokens written to a provider prompt cache.

`total_tokens: Option<u64>`

Total tokens when supplied by the producer.

Implementations

`impl LlmOptimizationTokens`

impl LlmOptimizationTokens

`saved_prompt`

pub fn saved_prompt(prompt_tokens: u64) -> Self

Construct explicit prompt and total token savings.

Trait Implementations

`impl Clone for LlmOptimizationTokens`

impl Clone for LlmOptimizationTokens

`clone`

fn clone(&self) -> LlmOptimizationTokens

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Debug for LlmOptimizationTokens`

impl Debug for LlmOptimizationTokens

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result

`impl Default for LlmOptimizationTokens`

impl Default for LlmOptimizationTokens

`default`

fn default() -> LlmOptimizationTokens

`impl<'de> Deserialize<'de> for LlmOptimizationTokens`

impl<'de> Deserialize<'de> for LlmOptimizationTokens

`deserialize`

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

`impl PartialEq for LlmOptimizationTokens`

impl PartialEq for LlmOptimizationTokens

`eq`

fn eq(&self, other: &LlmOptimizationTokens) -> bool

`ne`

fn ne(&self, other: &Rhs) -> bool

`impl Serialize for LlmOptimizationTokens`

impl Serialize for LlmOptimizationTokens

`serialize`

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

`impl Eq for LlmOptimizationTokens`

impl Eq for LlmOptimizationTokens

`impl StructuralPartialEq for LlmOptimizationTokens`

impl StructuralPartialEq for LlmOptimizationTokens