Trait Cost Estimator

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub trait CostEstimator: Send + Sync {
    // Required method
    fn estimate_cost_for_provider(
        &self,
        provider: Option<&str>,
        model: &str,
        usage: &Usage,
    ) -> Option<CostEstimate>;
}

Immutable price-estimation capability for a provider/model and token usage.

Required Methods

estimate_cost_for_provider

fn estimate_cost_for_provider(
    &self,
    provider: Option<&str>,
    model: &str,
    usage: &Usage,
) -> Option<CostEstimate>

Estimate cost using one consistent resolver snapshot.

Implementations on Foreign Types

impl CostEstimator for PricingResolver

impl CostEstimator for PricingResolver

estimate_cost_for_provider

fn estimate_cost_for_provider(
    &self,
    provider: Option<&str>,
    model: &str,
    usage: &Usage,
) -> Option<CostEstimate>

Implementors