For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
      • Python Library Reference
      • Node.js Library Reference
      • Rust Library Reference
        • nemo-relay
        • nemo-relay-adaptive
          • acg
            • anthropic_plugin
            • canonicalize
            • capability
              • BackendCapabilities
              • CacheEconomics
              • CapabilityRegistry
              • ModelFamilyCapabilities
              • ProviderFeature
            • ir_builder
            • openai_plugin
            • passthrough
            • plugin
            • plugin_registry
            • policy
            • profile
            • prompt_ir
            • retention
            • stability
            • telemetry
            • types
            • variable_extractor
            • error
            • MIN_ACG_OBSERVATIONS
          • acg_component
          • acg_learner
          • acg_profile
          • adaptive_hints_intercept
          • cache_diagnostics
          • config
          • context_helpers
          • drain
          • error
          • intercepts
          • learner
          • plugin_component
          • redis
          • storage
          • subscriber
          • tool_parallelism_learner
          • trie
          • types
          • AdaptiveRuntime
        • nemo-relay-ffi
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • Variants
  • ExplicitCacheBreakpoints
  • AutomaticPrefixCaching
  • RetentionTiers
  • PriorityScheduling
  • ModelRouting
  • DeferredToolLoading
  • FileReferences
  • StructuredOutput
  • PrefixAffinityHints
  • StreamingTokenCounts
  • Trait Implementations
  • impl Clone for ProviderFeature
  • clone
  • clone_from
  • impl Debug for ProviderFeature
  • fmt
  • impl<'de> Deserialize<'de> for ProviderFeature
  • deserialize
  • impl Hash for ProviderFeature
  • hash
  • hash_slice
  • impl PartialEq for ProviderFeature
  • eq
  • ne
  • impl Serialize for ProviderFeature
  • serialize
  • impl Copy for ProviderFeature
  • impl Eq for ProviderFeature
  • impl StructuralPartialEq for ProviderFeature
ReferenceAPIsRust Library Referencenemo-relay-adaptiveacgcapability

Enum Provider Feature

||View as Markdown|
Previous

Struct Model Family Capabilities

Next

Module ir_builder

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

1pub enum ProviderFeature {
2 ExplicitCacheBreakpoints,
3 AutomaticPrefixCaching,
4 RetentionTiers,
5 PriorityScheduling,
6 ModelRouting,
7 DeferredToolLoading,
8 FileReferences,
9 StructuredOutput,
10 PrefixAffinityHints,
11 StreamingTokenCounts,
12}

Feature that a backend or model family may support.

Used by the capability registry and policy engine to determine which optimization intents can be expressed for a given target.

Variants

ExplicitCacheBreakpoints

ExplicitCacheBreakpoints

Backend supports explicit cache control breakpoints (e.g., Anthropic).

AutomaticPrefixCaching

AutomaticPrefixCaching

Backend uses automatic prefix caching (e.g., OpenAI).

RetentionTiers

RetentionTiers

Backend supports retention tier control.

PriorityScheduling

PriorityScheduling

Backend supports priority-based scheduling.

ModelRouting

ModelRouting

Backend supports model routing/selection.

DeferredToolLoading

DeferredToolLoading

Backend supports deferred tool loading.

FileReferences

FileReferences

Backend supports file/artifact references in prompts.

StructuredOutput

StructuredOutput

Backend supports structured output schemas.

PrefixAffinityHints

PrefixAffinityHints

Backend supports prefix-affinity routing hints.

StreamingTokenCounts

StreamingTokenCounts

Backend reports per-chunk token counts in streaming responses.

Trait Implementations

impl Clone for ProviderFeature

impl Clone for ProviderFeature

clone

fn clone(&self) -> ProviderFeature

clone_from

fn clone_from(&mut self, source: &Self)

impl Debug for ProviderFeature

impl Debug for ProviderFeature

fmt

fn fmt(&self, f: &mut Formatter<'_>) -> Result

impl<'de> Deserialize<'de> for ProviderFeature

impl<'de> Deserialize<'de> for ProviderFeature

deserialize

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
    __D: Deserializer<'de>,

impl Hash for ProviderFeature

impl Hash for ProviderFeature

hash

fn hash<__H: Hasher>(&self, state: &mut __H)

hash_slice

fn hash_slice<H>(data: &[Self], state: &mut H)where
    H: Hasher,
    Self: Sized,

impl PartialEq for ProviderFeature

impl PartialEq for ProviderFeature

eq

fn eq(&self, other: &ProviderFeature) -> bool

ne

fn ne(&self, other: &Rhs) -> bool

impl Serialize for ProviderFeature

impl Serialize for ProviderFeature

serialize

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>where
    __S: Serializer,

impl Copy for ProviderFeature

impl Copy for ProviderFeature

impl Eq for ProviderFeature

impl Eq for ProviderFeature

impl StructuralPartialEq for ProviderFeature

impl StructuralPartialEq for ProviderFeature