ReferenceAPIsRust Library Referencenemo-relay

Module codec

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

LLM codec types, traits, and built-in implementations.

This module provides the type system and traits for bidirectional request codecs (traits::LlmCodec / request::AnnotatedLlmRequest), the decode-only response codec (traits::LlmResponseCodec / response::AnnotatedLlmResponse), and the streaming response codec (streaming::StreamingCodec) used with the managed streaming LLM execution pipeline.

Modules

  • anthropic: Built-in codec for the Anthropic Messages API.
  • openai_chat: Built-in codec for the OpenAI Chat Completions API.
  • openai_responses: Built-in codec for the OpenAI Responses API.
  • pricing: Data-driven LLM model pricing used to layer cost estimates onto usage.
  • request: LLM request codec types and trait.
  • response: Normalized LLM response types produced by response codecs.
  • streaming: Streaming response codecs for the managed LLM execution pipeline.
  • traits: LLM codec traits for bidirectional request translation.