Struct FfiStream

View as Markdown

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

1pub struct FfiStream { /* private fields */ }

Opaque stream handle for consuming LLM streaming responses chunk by chunk. Use nemo_relay_stream_next to poll and nemo_relay_stream_free to release.

Trait Implementations

impl Drop for FfiStream

impl Drop for FfiStream

drop

fn drop(&mut self)