Trait LlmStream Inner

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub trait LlmStreamInner: Stream<Item = Result<Value, FlowError>> + Send {
    // Required method
    fn close(
        self: Pin<&mut Self>,
    ) -> Pin<Box<dyn Future<Output = Result<(), FlowError>> + Send + '_>>;
​
    // Provided method
    fn terminalize(self: Pin<&mut Self>) { ... }
}

Internal close-aware stream implementation.

Required Methods

close

fn close(
    self: Pin<&mut Self>,
) -> Pin<Box<dyn Future<Output = Result<(), FlowError>> + Send + '_>>

Stop the producer and wait for cleanup. Implementations must be idempotent.

Provided Methods

terminalize

fn terminalize(self: Pin<&mut Self>)

Release lifecycle guards once the consumer-visible stream has ended while retaining the producer for a later explicit close.

Implementations on Foreign Types

impl LlmStreamInner for LlmStreamWrapper

impl LlmStreamInner for LlmStreamWrapper

close

fn close(
    self: Pin<&mut LlmStreamWrapper>,
) -> Pin<Box<dyn Future<Output = Result<(), FlowError>> + Send + '_>>

Implementors