OpenAI Streaming
module nemo_fabric.openai_streaming
Adapter-native OpenAI streaming for the NVIDIA NeMo Fabric Python SDK.
class OpenAIInvokeStream
Async iterator of OpenAI chat-completion chunks for one invocation.
Await result() for the separate normalized terminal result. Call aclose() when iteration stops early; it drains the stream without cancelling the invocation.
method aclose
Discard unread chunks and wait without cancelling the invocation.
method result
Drain the stream and return its separate normalized terminal result.
This file was automatically generated via lazydocs.