ReferenceAPIsRust Library Referencenemo-relay-plugin

Type Alias Nemo Relay Native Async LlmExecution Cb

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub type NemoRelayNativeAsyncLlmExecutionCb = unsafe extern "C" fn(user_data: *mut c_void, invocation_json: *const NemoRelayNativeString, context: *const NemoRelayNativeLlmExecutionContext, next: *const NemoRelayNativeAsyncNext, completion: *const NemoRelayNativeAsyncCompletion) -> u32;

Completion-based native LLM execution callback.

invocation_json and context are borrowed for the call. The callback may retain the invocation-scoped codec handles by returning Pending; they remain valid until the completion settles. The callback owns next and must release it exactly once after its final use.