Struct Nemo Relay Native LlmStream V1

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

#[repr(C)]pub struct NemoRelayNativeLlmStreamV1 {
    pub struct_size: usize,
    pub user_data: *mut c_void,
    pub next: Option<NemoRelayNativeLlmStreamPollFn>,
    pub cancel: NemoRelayNativeLlmStreamCancelFn,
    pub drop: NemoRelayNativeLlmStreamDropFn,
}

Native LLM JSON stream handle table.

Fields

struct_size: usize

Size of this struct as seen by the producer.

user_data: *mut c_void

Stream state passed back to poll/cancel/drop callbacks.

next: Option<NemoRelayNativeLlmStreamPollFn>

Polls the next stream chunk.

cancel: NemoRelayNativeLlmStreamCancelFn

Cancels an in-flight stream when a consumer stops before stream end.

drop: NemoRelayNativeLlmStreamDropFn

Drops stream state after stream completion, error, or cancellation.

Trait Implementations

impl Default for NemoRelayNativeLlmStreamV1

impl Default for NemoRelayNativeLlmStreamV1

default

fn default() -> Self