ReferenceAPIsRust Library Referencenemo-relaycodec

Module response

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

Normalized LLM response types produced by response codecs.

This module defines AnnotatedLlmResponse and its supporting types for structured, API-agnostic access to LLM response data.

Re-exports

  • pub use super::pricing::CacheReadAccounting;
  • pub use super::pricing::ModelPricing;
  • pub use super::pricing::PricingCatalog;
  • pub use super::pricing::PricingCatalogError;
  • pub use super::pricing::PricingConfig;
  • pub use super::pricing::PricingResolver;
  • pub use super::pricing::PricingSource;
  • pub use super::pricing::PricingSourceConfig;
  • pub use super::pricing::PricingUnit;
  • pub use super::pricing::PromptCachePricing;
  • pub use super::pricing::TokenPricingRates;
  • pub use super::pricing::active_pricing_resolver;
  • pub use super::pricing::attach_estimated_cost;
  • pub use super::pricing::attach_estimated_cost_for_provider;
  • pub use super::pricing::estimate_cost;
  • pub use super::pricing::estimate_cost_for_provider;
  • pub use super::pricing::estimate_cost_with_catalog;
  • pub use super::pricing::estimate_cost_with_provider;
  • pub use super::pricing::infer_model_provider;
  • pub use super::pricing::pricing_for_model;
  • pub use super::pricing::pricing_for_provider;
  • pub use super::pricing::reset_active_pricing_resolver;
  • pub use super::pricing::set_active_pricing_resolver;

Structs

  • AnnotatedLlmResponse: Structured view of an LLM response, produced by a response codec from raw JSON API output.
  • CostEstimate: Normalized LLM response cost.
  • ResponseToolCall: A tool call requested by the model in its response.
  • Usage: Token usage statistics from an LLM API response.

Enums

  • ApiSpecificResponse: API-specific response data that cannot be normalized across providers.
  • CostSource: Source of a normalized cost value.
  • FinishReason: Normalized reason why the model stopped generating.