nemo_relay.codecs

Generated from python/nemo_relay/codecs.pyi.

Module nemo_relay.codecs.

Protocol definitions for request and response codecs used by nemo_relay.llm.

Classes

LlmCodec(Protocol)

Protocol for request codecs used by annotated LLM intercepts.

Methods

decode

1
def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode a raw provider request into AnnotatedLLMRequest.

encode

1
def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Merge annotated edits back into the original raw request.

LlmResponseCodec(Protocol)

Protocol for codecs that normalize raw LLM responses.

Methods

decode_response

1
def decode_response(response: Json) -> AnnotatedLLMResponse

Decode a raw provider response into AnnotatedLLMResponse.

OpenAIChatCodec

Built-in codec for OpenAI Chat Completions requests and responses.

Methods

OpenAIChatCodec

1
def OpenAIChatCodec() -> None

Create an instance.

decode

1
def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode an OpenAI Chat Completions request.

encode

1
def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Encode a normalized request back into Chat Completions format.

decode_response

1
def decode_response(response: Json) -> AnnotatedLLMResponse

Decode an OpenAI Chat Completions response.

OpenAIResponsesCodec

Built-in codec for OpenAI Responses requests and responses.

Methods

OpenAIResponsesCodec

1
def OpenAIResponsesCodec() -> None

Create an instance.

decode

1
def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode an OpenAI Responses request.

encode

1
def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Encode a normalized request back into Responses format.

decode_response

1
def decode_response(response: Json) -> AnnotatedLLMResponse

Decode an OpenAI Responses response.

AnthropicMessagesCodec

Built-in codec for Anthropic Messages requests and responses.

Methods

AnthropicMessagesCodec

1
def AnthropicMessagesCodec() -> None

Create an instance.

decode

1
def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode an Anthropic Messages request.

encode

1
def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Encode a normalized request back into Messages format.

decode_response

1
def decode_response(response: Json) -> AnnotatedLLMResponse

Decode an Anthropic Messages response.