> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server. # Module model_pricing > Data-driven LLM model pricing used to layer cost estimates onto usage. Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`. Data-driven LLM model pricing used to layer cost estimates onto usage. Model pricing is deliberately separate from response normalization so adding providers, aliases, or cache-accounting rules does not require editing [`AnnotatedLlmResponse`](/reference/api/rust-library-reference/nemo-relay/codec/response/struct-annotatedllmresponse). ## Structs * [ModelPricing](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-modelpricing): Per-token model pricing expressed in USD per one million tokens. * [PricingCatalog](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingcatalog): Collection of model pricing entries. * [PricingConfig](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingconfig): Runtime model pricing resolver configuration. * [PricingResolver](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingresolver): Ordered model pricing lookup chain. * [PromptCachePricing](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-promptcachepricing): Prompt-cache accounting rules for a model pricing entry. * [TokenPricingRates](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenpricingrates): Token rates expressed as USD per one million tokens. * [TokenRateTier](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenratetier): A model pricing tier selected by prompt/input token count. ## Enums * [CacheReadAccounting](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-cachereadaccounting): How cache-read tokens relate to prompt token counts in provider usage. * [PricingCatalogError](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingcatalogerror): Errors produced while parsing or validating a model pricing catalog. * [PricingSourceConfig](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingsourceconfig): Declarative model pricing source supported by Relay configuration. * [PricingUnit](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingunit): Billing unit represented by a model pricing entry. * [RateScheduleApplication](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-ratescheduleapplication): How a selected rate-schedule tier applies to billable usage. * [TokenRateSchedule](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-tokenrateschedule): Data-driven token rate schedule for model pricing with request thresholds. ## Traits * [PricingSource](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/trait-pricingsource): Pluggable model pricing source interface. ## Functions * [active\_pricing\_resolver](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-active-pricing-resolver): Returns the active process-wide model pricing resolver. * [attach\_estimated\_cost](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost): Adds a model pricing estimate to a normalized response when cost is missing. * [attach\_estimated\_cost\_for\_provider](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost-for-provider): Adds a provider-aware model pricing estimate to a normalized response when cost is missing. * [estimate\_cost](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost): Estimates USD cost for a model/usage pair when model pricing is known. * [estimate\_cost\_for\_provider](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-for-provider): Estimates USD cost for a provider/model pair when model pricing is known. * [estimate\_cost\_with\_catalog](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-catalog): Estimates USD cost using the provided catalog. * [estimate\_cost\_with\_provider](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-provider): Estimates USD cost using the provided catalog and provider/model pair. * [infer\_model\_provider](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-infer-model-provider): Infers a provider/route value for a decoded model. * [pricing\_for\_model](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-model): Returns known model pricing for a model ID. * [pricing\_for\_provider](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-provider): Returns known model pricing for a provider/model pair. * [reset\_active\_pricing\_resolver](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-reset-active-pricing-resolver): Restores the active process-wide model pricing resolver to an empty resolver. * [set\_active\_pricing\_resolver](/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-set-active-pricing-resolver): Replaces the active process-wide model pricing resolver. > Data-driven LLM model pricing used to layer cost estimates onto usage. ## Docs - [Enum Cache Read Accounting](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-cachereadaccounting.md): How cache-read tokens relate to prompt token counts in provider usage. - [Struct Model Pricing](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-modelpricing.md): Per-token model pricing expressed in USD per one million tokens. - [Struct Pricing Catalog](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingcatalog.md): Collection of model pricing entries. - [Enum Pricing Catalog Error](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingcatalogerror.md): Errors produced while parsing or validating a model pricing catalog. - [Struct Pricing Config](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingconfig.md): Runtime model pricing resolver configuration. - [Struct Pricing Resolver](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-pricingresolver.md): Ordered model pricing lookup chain. - [Struct Token Rate Tier](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenratetier.md): A model pricing tier selected by prompt/input token count. - [Trait Pricing Source](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/trait-pricingsource.md): Pluggable model pricing source interface. - [Enum Pricing Source Config](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingsourceconfig.md): Declarative model pricing source supported by Relay configuration. - [Enum Pricing Unit](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-pricingunit.md): Billing unit represented by a model pricing entry. - [Struct Prompt Cache Pricing](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-promptcachepricing.md): Prompt-cache accounting rules for a model pricing entry. - [Struct Token Pricing Rates](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/struct-tokenpricingrates.md): Token rates expressed as USD per one million tokens. - [Enum Rate Schedule Application](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-ratescheduleapplication.md): How a selected rate-schedule tier applies to billable usage. - [Function active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-active-pricing-resolver.md): Returns the active process-wide model pricing resolver. - [Enum Token Rate Schedule](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/enum-tokenrateschedule.md): Data-driven token rate schedule for model pricing with request thresholds. - [Function attach_estimated_cost](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost.md): Adds a model pricing estimate to a normalized response when cost is missing. - [Function attach_estimated_cost_for_provider](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-attach-estimated-cost-for-provider.md): Adds a provider-aware model pricing estimate to a normalized response when cost is missing. - [Function estimate_cost](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost.md): Estimates USD cost for a model/usage pair when model pricing is known. - [Function estimate_cost_for_provider](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-for-provider.md): Estimates USD cost for a provider/model pair when model pricing is known. - [Function estimate_cost_with_catalog](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-catalog.md): Estimates USD cost using the provided catalog. - [Function estimate_cost_with_provider](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-estimate-cost-with-provider.md): Estimates USD cost using the provided catalog and provider/model pair. - [Function infer_model_provider](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-infer-model-provider.md): Infers a provider/route value for a decoded model. - [Function pricing_for_model](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-model.md): Returns known model pricing for a model ID. - [Function pricing_for_provider](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-pricing-for-provider.md): Returns known model pricing for a provider/model pair. - [Function reset_active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-reset-active-pricing-resolver.md): Restores the active process-wide model pricing resolver to an empty resolver. - [Function set_active_pricing_resolver](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay/codec/model_pricing/fn-set-active-pricing-resolver.md): Replaces the active process-wide model pricing resolver.