Skip to navigation

Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.

pub struct LlmInputStream(/* private fields */);

Downstream LLM stream that reports whether its cleanup succeeded.

The stream closes its downstream source when it ends or is dropped, as LlmStreamNext::call streams do. Self::close waits for that cleanup.

Implementations

impl LlmInputStream

impl LlmInputStream

close

pub async fn close(&mut self) -> Result<()>

Close the downstream stream, or wait for the close that its end started, and return the cleanup result.

A failed cleanup is reported again on later calls rather than retried; component shutdown retries it.

Trait Implementations

impl Stream for LlmInputStream

impl Stream for LlmInputStream

Item

type Item = Result<Value, String>

poll_next

fn poll_next(
    self: Pin<&mut Self>,
    cx: &mut Context<'_>,
) -> Poll<Option<Self::Item>>

size_hint

fn size_hint(&self) -> (usize, Option<usize>)