ReferenceAPIsRust Library Referencenemo-relay-plugin

Type Alias Nemo Relay Native LlmStream Next Fn

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type NemoRelayNativeLlmStreamNextFn = unsafe extern "C" fn(request_json: *const NemoRelayNativeString, next_ctx: *mut c_void, out_stream: *mut NemoRelayNativeLlmStreamV1) -> NemoRelayStatus;

Runtime-provided continuation for LLM stream execution intercepts.