Struct Plugin Input | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

pub struct PluginInput<'a> {
    pub original_request: &'a LlmRequest,
    pub rewritten_request: &'a LlmRequest,
    pub prompt_ir: &'a PromptIR,
    pub intent_bundle: &'a OptimizationIntentBundle,
    pub agent_identity: &'a AgentIdentity,
}

Input data provided to a plugin for translation.

All fields are borrowed references to avoid unnecessary cloning. The lifetime 'a ties the input to the caller’s data.

Fields

`original_request: &'a LlmRequest`

The original (pre-rewrite) request.

`rewritten_request: &'a LlmRequest`

The rewritten request (may be identical to original in early phases).

`prompt_ir: &'a PromptIR`

The Prompt IR decomposition of the request.

`intent_bundle: &'a OptimizationIntentBundle`

The optimization intent bundle from the policy engine.

`agent_identity: &'a AgentIdentity`

The agent identity for context.

Trait Implementations

`impl<'a> Debug for PluginInput<'a>`

impl<'a> Debug for PluginInput<'a>

`fmt`

fn fmt(&self, f: &mut Formatter<'_>) -> Result