Type Alias Nemo Relay Native Async LlmStream Pull Cb

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type NemoRelayNativeAsyncLlmStreamPullCb = unsafe extern "C" fn(user_data: *mut c_void, chunk_json: *const NemoRelayNativeString, error: *const NemoRelayNativeString, done: bool);

Receives one item from a pull-based downstream LLM stream.

A chunk has non-null chunk_json and done = false; clean completion has both strings null and done = true; failure has non-null error and done = true. Only one pull may be outstanding per stream.