ReferenceAPIPython Library Reference

OpenAI Streaming

View as Markdown

module nemo_fabric.openai_streaming

Adapter-native OpenAI streaming for the NVIDIA NeMo Fabric Python SDK.


class OpenAIInvokeStream

Async iterator of OpenAI chat-completion chunks for one invocation.

Await result() for the separate normalized terminal result. Call aclose() when iteration stops early; it drains the stream without cancelling the invocation.


method aclose

1async def aclose() -> None

Discard unread chunks and wait without cancelling the invocation.


method result

1async def result() -> RunResult

Drain the stream and return its separate normalized terminal result.


This file was automatically generated via lazydocs.