Function wrap_llm_stream_exec_fn
Function wrap_llm_stream_exec_fn
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.
pub fn wrap_llm_stream_exec_fn(
cb: NemoRelayLlmExecCb,
user_data: *mut c_void,
free_fn: NemoRelayFreeFn,
) -> Box<dyn Fn(LlmRequest) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<Value>> + Send>>>> + Send>> + Send + Sync>
Wrap a C LLM execution callback into an async Rust closure that returns a stream. The C callback returns the full response as a single JSON string, which is emitted as a single-item stream of Json values.