Type Alias LlmFinalizer Fn

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type LlmFinalizerFn = Box<dyn FnOnce() -> Json + Send>;

Finalizer used to synthesize the aggregate streaming response payload.

Parameters

This callback takes no arguments.

Returns

Aggregate response JSON synthesized from collected stream chunks.

Aliased Type

1
pub struct LlmFinalizerFn(/* private fields */);