Struct Anthropic Cache Plugin | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

1 pub struct AnthropicCachePlugin { /* private fields */ }

Anthropic-specific provider plugin for cache_control breakpoint injection.

Translates CacheStability and Retention intents into Anthropic’s explicit cache_control annotations. Other intent types are marked Ignored / NotRelevant.

Construction

1 let registry = CapabilityRegistry::with_defaults();
2 let plugin = AnthropicCachePlugin::new(&registry);

Implementations

`impl AnthropicCachePlugin`

impl AnthropicCachePlugin

`new`

pub fn new(registry: &CapabilityRegistry) -> Self

Create a new Anthropic cache plugin backed by the given capability registry.

The registry is cloned into an Arc for shared ownership.

Trait Implementations

`impl ProviderPlugin for AnthropicCachePlugin`

impl ProviderPlugin for AnthropicCachePlugin

`plugin_id`

fn plugin_id(&self) -> &str

`plugin_name`

fn plugin_name(&self) -> &str

`translate`

fn translate(&self, input: &PluginInput<'_>) -> Result<PluginOutput>

`capabilities`

fn capabilities(&self) -> BackendCapabilities