ReferenceAPIsRust Library Referencenemo-relay

Module codec

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

LLM codec types, traits, and built-in implementations.

This module provides the type system and traits for bidirectional request codecs (traits::LlmCodec / request::AnnotatedLlmRequest), the decode-only response codec (traits::LlmResponseCodec / response::AnnotatedLlmResponse), and the streaming response codec (streaming::StreamingCodec) used with the managed streaming LLM execution pipeline.

resolve is the detect-then-decode entry point for selecting a built-in provider codec from a raw payload when no codec annotation is present.

Modules

  • anthropic: Built-in codec for the Anthropic Messages API.
  • model_pricing: Data-driven LLM model pricing used to layer cost estimates onto usage.
  • openai_chat: Built-in codec for the OpenAI Chat Completions API.
  • openai_responses: Built-in codec for the OpenAI Responses API.
  • request: Re-exported normalized LLM request data types.
  • resolve: Provider-surface detection and best-effort normalization: the preferred path for turning raw provider JSON into normalized types when no codec annotation is present.
  • response: Re-exported normalized LLM response data types and core pricing helpers.
  • streaming: Streaming response codecs for the managed LLM execution pipeline.
  • traits: LLM codec traits for bidirectional request translation.