Type Alias LlmExecution Next Fn
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.
pub type LlmExecutionNextFn = Arc<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;
Continuation type invoked by non-streaming LLM execution intercepts.
Execution intercepts use this callable to continue the non-streaming LLM pipeline after applying their own logic.
Parameters
- First argument: LLM request to pass to the remaining execution chain.
Returns
A future resolving to the provider response JSON.
Errors
The future resolves to an error when the remaining execution chain fails.