> This page is for NeMo Relay, version dev.
> For other versions, use one of these documentation indexes:
> - Latest (v0.11.1) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
> - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
> - v0.11.1: https://docs.nvidia.com/nemo/relay/v0.11.1/llms.txt
> - v0.10.4: https://docs.nvidia.com/nemo/relay/v0.10.4/llms.txt
> - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
> - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
> - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Enum LlmCollector

> Collector used to accumulate streaming response chunks.

Generated from `cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

<pre />

Collector used to accumulate streaming response chunks.

An asynchronous collector still pending at `close()` is awaited after the producer closes, so it must settle once the producer does. Any `FnMut(Json) -> Result<()>` converts into the synchronous form.

## Variants

### `Sync(Box<dyn FnMut(Value) -> Result<(), FlowError> + Send>)`

<pre />

Runs inline while the stream is polled.

### `Async(Box<dyn FnMut(Value) -> Pin<Box<dyn Future<Output = Result<(), FlowError>> + Send>> + Send>)`

<pre />

Awaited before its chunk is yielded.

## Implementations

### `impl LlmCollector`

<pre />

#### `new_async`

<pre />

Wrap a future-returning closure as an asynchronous collector.

## Trait Implementations

### `impl<F> From<F> for LlmCollectorwhere F: FnMut(Value) -> Result<(), FlowError> + Send + 'static,`

<pre />

#### `from`

<pre />