ReferenceAPIsRust Library Referencenemo-relay-typescodec

Module response

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Normalized LLM response data types. Normalized LLM response types produced by response codecs.

This module defines [AnnotatedLlmResponse] and its supporting types for structured, API-agnostic access to LLM response data.

Structs

  • AnnotatedLlmResponse: Structured view of an LLM response, produced by a response codec from raw JSON API output.
  • CostEstimate: Normalized LLM response cost.
  • ResponseToolCall: A tool call requested by the model in its response.
  • Usage: Token usage statistics from an LLM API response.

Enums

  • ApiSpecificResponse: API-specific response data that cannot be normalized across providers.
  • CostSource: Source of a normalized cost value.
  • FinishReason: Normalized reason why the model stopped generating.