Module request

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

Normalized LLM request data types. LLM request codec types and trait.

This module defines the [AnnotatedLlmRequest] type system for structured LLM request representation and the [crate::codec::traits::LlmCodec] trait for bidirectional translation between opaque crate::api::llm::LlmRequest payloads and typed form.

Structs

Enums

  • ContentPart: A single content part within a multimodal message.
  • Message: A single message in a conversation, tagged by role.
  • MessageContent: Message content: either a plain string or multimodal parts array.
  • ToolChoice: Tool choice control: how the model should use available tools.