This page is for NeMo Relay, version Latest (v0.10.0) (default).
For other versions, use one of these documentation indexes:
- Latest (v0.10.0) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
- dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
- v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
- v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
- v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
- v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
- v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
- v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
Opaque stream handle for consuming LLM streaming responses chunk by chunk. Use nemo_relay_stream_next to poll and nemo_relay_stream_free to release.
Trait Implementations
impl Drop for FfiStream
impl Drop for FfiStream
drop
fn drop(&mut self)
