Function wrap_llm_exec_intercept_fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub fn wrap_llm_exec_intercept_fn(
    cb: NemoRelayLlmExecInterceptCb,
    user_data: *mut c_void,
    free_fn: NemoRelayFreeFn,
) -> Arc<dyn Fn(&str, LlmRequest, LlmExecutionNextFn) -> Pin<Box<dyn Future<Output = Result<Value>> + Send>> + Send + Sync>

Wrap a C LLM execution intercept callback into an Arc<dyn Fn(LlmRequest, LlmExecutionNextFn) -> ...>.