module nemo_fabric.streaming

NeMo Relay streaming support for the NVIDIA NeMo Fabric Python SDK.

class InvokeStream

Async iterator of raw ATOF records for one runtime invocation.

Consume the final normalized result separately with :meth:result. If iteration stops early, call :meth:aclose before starting another turn.

method aclose

1
async def aclose() -> None

Stop iteration and drain this turn without cancelling the invocation.

method result

1
async def result() -> RunResult

Return the terminal normalized result without adding it to the stream.

This file was automatically generated via lazydocs.