ReferenceAPIsRust Library Referencenemo-relaycodec

Module response

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

Normalized LLM response types produced by response codecs.

This module defines AnnotatedLlmResponse and its supporting types for structured, API-agnostic access to LLM response data.

Structs

  • AnnotatedLlmResponse: Structured view of an LLM response, produced by a response codec from raw JSON API output.
  • ResponseToolCall: A tool call requested by the model in its response.
  • Usage: Token usage statistics from an LLM API response.

Enums

  • ApiSpecificResponse: API-specific response data that cannot be normalized across providers.
  • FinishReason: Normalized reason why the model stopped generating.