This page is for NeMo Relay, version Latest (v0.10.0) (default).
For other versions, use one of these documentation indexes:
- Latest (v0.10.0) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
- dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
- v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
- v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
- v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
- v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
- v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
- v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt
Function attach_estimated_cost
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
pub fn attach_estimated_cost(response: &mut AnnotatedLlmResponse)
Adds a model pricing estimate to a normalized response when cost is missing.
Existing provider-reported or caller-supplied costs are preserved.
