Module optimization
Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker.
Re-exported plugin-neutral LLM optimization data types.
Structs
- LlmOptimizationContribution: One optimizer’s evidence for a change to an LLM call.
- LlmOptimizationKind: Open, forward-compatible optimization classification.
- LlmOptimizationModel: Model identity used for counterfactual and effective pricing.
- LlmOptimizationModelTransition: A model change proposed or applied by an optimizer.
- LlmOptimizationSummary: Close-time accounting attached to the normalized LLM response.
- LlmOptimizationTokenImpact: Shared token evidence that Relay can aggregate without understanding a plugin payload.
- LlmOptimizationTokens: Token quantities retained independently from pricing arithmetic.
Enums
- LlmOptimizationEvidenceQuality: Whether token evidence was observed directly or estimated.
- LlmOptimizationSummaryStatus: Completeness of close-time optimization accounting.
Traits
- LlmOptimizationPayload: Trait implemented by typed plugin payloads embedded in an optimization contribution.