ReferenceAPIsRust Library Referencenemo-relayapiruntimecallbacks

Type Alias LlmCollector Fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type LlmCollectorFn = Box<dyn FnMut(Json) -> Result<()> + Send>;

Per-chunk collector used by the streaming LLM runtime.

Parameters

  • First argument: One JSON chunk emitted by the provider stream.

Returns

A Result that is Ok(()) when the chunk was collected.

Errors

The callback can return any FlowError to abort stream processing.

Aliased Type

1pub struct LlmCollectorFn(/* private fields */);