Trait LlmStream Inner

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub trait LlmStreamInner: Stream<Item = Result<Json>> + Send {
    // Required method
    fn close(
        self: Pin<&mut Self>,
    ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + '_>>;
​
    // Provided method
    fn terminalize(self: Pin<&mut Self>) { ... }
}

Internal close-aware stream implementation.

Required Methods

close

fn close(
    self: Pin<&mut Self>,
) -> Pin<Box<dyn Future<Output = Result<()>> + Send + '_>>

Stop the producer and wait for cleanup. Implementations must be idempotent.

Provided Methods

terminalize

fn terminalize(self: Pin<&mut Self>)

Release lifecycle guards once the consumer-visible stream has ended while retaining the producer for a later explicit close.

Implementors

impl LlmStreamInner for LlmStreamWrapper

impl LlmStreamInner for LlmStreamWrapper