Skip to navigation

nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream

View as MarkdownOpen in Claude

Declare LiteLLM stream fields while retaining OpenAI event semantics.

LiteLLM’s root and delta extension bags are optional, nullable, and closed. Terminal root extensions preserve reviewed response metadata. Source-declared content arrays remain empty-only except typed reasoning items with no plaintext content. The classifier derives coverage and text paths from these rebound models; the endpoint uses the existing per-stream OpenAI lifecycle hooks.

Module Contents

Classes

NameDescription
LiteLLMReasoningItemProjectionPreserve encrypted metadata while keeping plaintext and unknown fields closed.
LiteLLMStreamChoiceProjectionKeep single-choice constraints and bind the LiteLLM delta model.
LiteLLMStreamDeltaProjectionAccept reviewed encrypted reasoning and empty-only content extensions.
LiteLLMStreamFieldsRecognize an empty extension bag without authorizing arbitrary contents.
LiteLLMStreamPayloadProjectionRecognize LiteLLM’s root extension bag, including on usage-only events.
LiteLLMTerminalMetadataDeclare the terminal root extension separately from delta extensions.

Data

STREAM_CLASSIFIER

STREAM_CONTRACT

STREAM_RULES

API

class nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.LiteLLMReasoningItemProjection()

Bases: ResponsesReasoningItemProjection

Preserve encrypted metadata while keeping plaintext and unknown fields closed.

policy
ObjectPolicy
class nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.LiteLLMStreamChoiceProjection()

Bases: ChatCompletionsStreamChoiceProjection

Keep single-choice constraints and bind the LiteLLM delta model.

delta
Annotated[LiteLLMStreamDeltaProjection, guarded()]
class nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.LiteLLMStreamDeltaProjection()

Bases: ChatCompletionsStreamDeltaProjection

Accept reviewed encrypted reasoning and empty-only content extensions.

annotations
Annotated[list[Any] | None, constrained(reason=(core_capability.citation_content), max_length=0)] = None
images
Annotated[list[Any] | None, constrained(reason=(core_capability.multimodal_content), max_length=0)] = None
policy
ObjectPolicy
provider_specific_fields
Annotated[LiteLLMStreamFields | None, constrained()] = None
reasoning_items
Annotated[list[LiteLLMReasoningItemProjection] | None, constrained()] = None
thinking_blocks
Annotated[list[Any] | None, constrained(reason=(core_capability.reasoning_content), max_length=0)] = None
class nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.LiteLLMStreamFields()

Bases: PolicyModel

Recognize an empty extension bag without authorizing arbitrary contents.

class nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.LiteLLMStreamPayloadProjection()

Bases: ChatCompletionsStreamPayloadProjection

Recognize LiteLLM’s root extension bag, including on usage-only events.

access_programs
Annotated[Any, opaque()] = None
billing
Annotated[Any, opaque()] = None
choices
Annotated[list[LiteLLMStreamChoiceProjection], guarded(max_length=1)]
frequency_penalty
Annotated[Any, opaque()] = None
image
Annotated[ResponseImageProjection | None, constrained()] = None
input_transformations
InputTransformations = None
policy
ObjectPolicy
presence_penalty
Annotated[Any, opaque()] = None
provider_specific_fields
Annotated[LiteLLMTerminalMetadata | None, constrained()] = None
tool_usage
Annotated[Any, opaque()] = None
class nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.LiteLLMTerminalMetadata()

Bases: PolicyModel

Declare the terminal root extension separately from delta extensions.

access_programs
Annotated[Any, opaque()] = None
billing
Annotated[Any, opaque()] = None
frequency_penalty
Annotated[Any, opaque()] = None
image
Annotated[ResponseImageProjection | None, constrained()] = None
input_transformations
InputTransformations = None
presence_penalty
Annotated[Any, opaque()] = None
service_tier
Annotated[Any, opaque()] = None
tool_usage
Annotated[Any, opaque()] = None
nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.STREAM_CLASSIFIER = build_policy_stream_classifier(StreamClassifierDefinition(subject=(STREAM_CONTRA...
nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.STREAM_CONTRACT = replace(OPENAI_STREAM_CONTRACT, projection_id='openai.litellm.chat_completions.s...
nemoguardrails.server.experimental.providers.openai.dialects.litellm.stream.STREAM_RULES = tuple((replace(rule, model=LiteLLMStreamPayloadProjection, text_path=(stream_tex...