Type Alias LlmCollector Fn
Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
pub type LlmCollectorFn = Box<dyn FnMut(Value) -> Result<(), FlowError> + Send>;
Per-chunk collector used by the streaming LLM runtime.
Parameters
- First argument: One JSON chunk emitted by the provider stream.
Returns
A Result that is Ok(()) when the chunk was collected.
Errors
The callback can return any FlowError to abort stream processing.