Module request

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

LLM request codec types and trait.

This module defines the AnnotatedLlmRequest type system for structured LLM request representation and the crate::codec::traits::LlmCodec trait for bidirectional translation between opaque crate::api::llm::LlmRequest payloads and typed form.

Structs

Enums

  • ContentPart: A single content part within a multimodal message.
  • Message: A single message in a conversation, tagged by role.
  • MessageContent: Message content: either a plain string or multimodal parts array.
  • ToolChoice: Tool choice control: how the model should use available tools.