Type Alias LlmExecution Next Fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub type LlmExecutionNextFn = Arc<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;

Continuation type invoked by non-streaming LLM execution intercepts.

Execution intercepts use this callable to continue the non-streaming LLM pipeline after applying their own logic.

Parameters

  • First argument: LLM request to pass to the remaining execution chain.

Returns

A future resolving to the provider response JSON.

Errors

The future resolves to an error when the remaining execution chain fails.

Aliased Type

1pub struct LlmExecutionNextFn { /* private fields */ }