ReferenceAPIsRust Library Referencenemo-relay-fficallable

Function wrap_llm_exec_fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub fn wrap_llm_exec_fn(
    cb: NemoRelayLlmExecCb,
    user_data: *mut c_void,
    free_fn: NemoRelayFreeFn,
) -> Box<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Value>> + Send>> + Send + Sync>

Wrap a C LLM execution callback into an async Rust closure. The C callback receives an LlmRequest serialized as a JSON string.