ReferenceAPIsRust Library Referencenemo-relay-fficallable

Function wrap_llm_stream_exec_intercept_fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub fn wrap_llm_stream_exec_intercept_fn(
    cb: NemoRelayLlmExecInterceptCb,
    user_data: *mut c_void,
    free_fn: NemoRelayFreeFn,
) -> Arc<dyn Fn(&str, LlmRequest, LlmStreamExecutionNextFn) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<Value>> + Send>>>> + Send>> + Send + Sync>

Wrap a C LLM stream execution intercept callback. Since the C callback returns a single string (not a real stream), this wraps it as a single-item stream, same as wrap_llm_stream_exec_fn.