ReferenceAPIsRust Library Referencenemo-relay-plugin

Type Alias Nemo Relay Native LlmStream Poll Fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type NemoRelayNativeLlmStreamPollFn = unsafe extern "C" fn(user_data: *mut c_void, out_json: *mut *mut NemoRelayNativeString) -> NemoRelayStatus;

Native stream poll callback.

Return NemoRelayStatus::Ok with out_json set for one chunk, NemoRelayStatus::StreamEnd with out_json null at end of stream, or an error status for stream failure.