ReferenceAPIsRust Library Referencenemo-relayapiruntimecallbacks

Type Alias LlmCollector Fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub type LlmCollectorFn = Box<dyn FnMut(Json) -> Result<()> + Send>;

Per-chunk collector used by the streaming LLM runtime.

Parameters

  • First argument: One JSON chunk emitted by the provider stream.

Returns

A Result that is Ok(()) when the chunk was collected.

Errors

The callback can return any FlowError to abort stream processing.

Aliased Type

1pub struct LlmCollectorFn(/* private fields */);