Function nemo_relay_stream_next

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

#[unsafe(no_mangle)]pub unsafe extern "C" fn nemo_relay_stream_next(
    stream: *mut FfiStream,
    out_chunk: *mut *mut c_char,
) -> i32

Poll the next chunk from a streaming LLM response. Blocks until a chunk is available.

Returns

  • 1: A chunk was written to *out_chunk. Caller must free with nemo_relay_string_free.
  • 0: The stream is complete (no more chunks).
  • -1: An error occurred. Call nemo_relay_last_error for details.

Safety

stream and out_chunk must be valid, non-null pointers.