nemo_relay.codecs

Generated from python/nemo_relay/codecs.pyi.

Module nemo_relay.codecs.

Protocol definitions for request and response codecs used by nemo_relay.llm.

Classes

`LlmCodec(Protocol)`

Protocol for request codecs used by annotated LLM intercepts.

Methods

`decode`

1 def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode a raw provider request into AnnotatedLLMRequest.

`encode`

1 def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Merge annotated edits back into the original raw request.

`LlmResponseCodec(Protocol)`

Protocol for codecs that normalize raw LLM responses.

Methods

`decode_response`

1 def decode_response(response: Json) -> AnnotatedLLMResponse

Decode a raw provider response into AnnotatedLLMResponse.

`OpenAIChatCodec`

Built-in codec for OpenAI Chat Completions requests and responses.

Methods

`OpenAIChatCodec`

1 def OpenAIChatCodec() -> None

Create an instance.

`decode`

1 def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode an OpenAI Chat Completions request.

`encode`

1 def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Encode a normalized request back into Chat Completions format.

`decode_response`

1 def decode_response(response: Json) -> AnnotatedLLMResponse

Decode an OpenAI Chat Completions response.

`OpenAIResponsesCodec`

Built-in codec for OpenAI Responses requests and responses.

Methods

`OpenAIResponsesCodec`

1 def OpenAIResponsesCodec() -> None

Create an instance.

`decode`

1 def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode an OpenAI Responses request.

`encode`

1 def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Encode a normalized request back into Responses format.

`decode_response`

1 def decode_response(response: Json) -> AnnotatedLLMResponse

Decode an OpenAI Responses response.

`AnthropicMessagesCodec`

Built-in codec for Anthropic Messages requests and responses.

Methods

`AnthropicMessagesCodec`

1 def AnthropicMessagesCodec() -> None

Create an instance.

`decode`

1 def decode(request: LLMRequest) -> AnnotatedLLMRequest

Decode an Anthropic Messages request.

`encode`

1 def encode(annotated: AnnotatedLLMRequest, original: LLMRequest) -> LLMRequest

Encode a normalized request back into Messages format.

`decode_response`

1 def decode_response(response: Json) -> AnnotatedLLMResponse

Decode an Anthropic Messages response.