Type Alias LlmFinalizer Fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub type LlmFinalizerFn = Box<dyn FnOnce() -> Json + Send>;

Finalizer used to synthesize the aggregate streaming response payload.

Parameters

This callback takes no arguments.

Returns

Aggregate response JSON synthesized from collected stream chunks.

Aliased Type

1pub struct LlmFinalizerFn(/* private fields */);