Skip to navigation

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type LlmCollectorFn = Box<dyn FnMut(Value) -> Result<(), FlowError> + Send>;

Per-chunk collector used by the streaming LLM runtime.

Parameters

  • First argument: One JSON chunk emitted by the provider stream.

Returns

A Result that is Ok(()) when the chunk was collected.

Errors

The callback can return any FlowError to abort stream processing.

Aliased Type

pub struct LlmCollectorFn(/* private fields */);