Struct Runtime Services

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct RuntimeServices {
    pub pricing_snapshot: fn() -> Arc<dyn CostEstimator>,
    pub infer_model_provider: fn(&str, Option<&str>) -> Option<String>,
    pub attach_estimated_cost: fn(&mut AnnotatedLlmResponse, Option<&str>),
}

Composition callbacks owned by the embedding host, independent from the runtime engine.

Fields

`pricing_snapshot: fn() -> Arc<dyn CostEstimator>`

Capture the current immutable pricing resolver.

`infer_model_provider: fn(&str, Option<&str>) -> Option<String>`

Infer the provider label used for price lookup.

`attach_estimated_cost: fn(&mut AnnotatedLlmResponse, Option<&str>)`

Attach estimates without replacing provider-reported costs.

Trait Implementations

`impl Clone for RuntimeServices`

impl Clone for RuntimeServices

`clone`

fn clone(&self) -> RuntimeServices

`clone_from`

fn clone_from(&mut self, source: &Self)

`impl Default for RuntimeServices`

impl Default for RuntimeServices

`default`

fn default() -> Self

`impl Copy for RuntimeServices`

impl Copy for RuntimeServices