nat.llm.utils.constants

Classes

LLMHeaderPrefix	HTTP header prefixes used by LLM clients for metadata and routing.
LLMFinishReason	LLM finish_reason values used for response validation.

Module Contents

class LLMHeaderPrefix

Bases: enum.StrEnum

HTTP header prefixes used by LLM clients for metadata and routing.

Initialize self. See help(type(self)) for accurate signature.

PAYLOAD = 'X-Payload'

DYNAMO = 'x-prefix'

class LLMFinishReason

Bases: enum.StrEnum

LLM finish_reason values used for response validation.

Initialize self. See help(type(self)) for accurate signature.

STOP = 'stop'

LENGTH = 'length'

CONTENT_FILTER = 'content_filter'

TOOL_CALLS = 'tool_calls'