Struct LlmInput Stream
Generated from cargo doc --no-deps -p nemo-relay-builtins -p nemo-relay-diagnostics -p nemo-relay-logging -p nemo-relay-plugin-host -p nemo-relay-codecs -p nemo-relay -p nemo-relay-runtime -p nemo-relay-model-pricing -p nemo-relay-resource-metrics -p nemo-relay-observability -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
Downstream LLM stream that reports whether its cleanup succeeded.
The stream closes its downstream source when it ends or is dropped, as LlmStreamNext::call streams do. Self::close waits for that cleanup.
Implementations
impl LlmInputStream
impl LlmInputStream
close
pub async fn close(&mut self) -> Result<()>
Close the downstream stream, or wait for the close that its end started, and return the cleanup result.
A failed cleanup is reported again on later calls rather than retried; component shutdown retries it.
Trait Implementations
impl Stream for LlmInputStream
impl Stream for LlmInputStream
Item
type Item = Result<Value, String>
poll_next
fn poll_next(
self: Pin<&mut Self>,
cx: &mut Context<'_>,
) -> Poll<Option<Self::Item>>
size_hint
fn size_hint(&self) -> (usize, Option<usize>)