Type Alias LlmExecution Next Fn
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
pub type LlmExecutionNextFn = Arc<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Json>> + Send>> + Send + Sync>;Continuation type invoked by non-streaming LLM execution intercepts.
Execution intercepts use this callable to continue the non-streaming LLM pipeline after applying their own logic.
Parameters
- First argument: LLM request to pass to the remaining execution chain.
Returns
A future resolving to the provider response JSON.
Errors
The future resolves to an error when the remaining execution chain fails.
Lifetime
This continuation can be called repeatedly or concurrently while its execution-intercept callback is still running. Each invocation receives an isolated snapshot of the scopes visible when next is called. Calls that remain unfinished or begin after the interceptor settles are rejected.