For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
  • About NVIDIA NeMo Relay
    • Overview
    • Architecture
    • Ecosystem
    • Concepts
    • Release Notes
  • Getting Started
    • Agent Runtime Primer
    • Prerequisites
    • Installation
    • Configuration / Setup
    • Quick Start
  • NVIDIA NeMo Relay CLI
    • About
    • Basic Usage
    • Claude Code
    • Codex
    • Cursor
    • Hermes Agent
  • Supported Integrations
    • About
    • OpenClaw Plugin Guide
    • LangChain Integration Guide
    • LangGraph Integration Guide
    • Deep Agents Integration Guide
  • Instrument Applications
    • About
    • Adding Scopes and Marks
    • Instrument a Tool Call
    • Instrument an LLM Call
    • Add Middleware
    • Code Examples
  • Observability Plugin
    • About
    • Configuration
    • Agent Trajectory Interchange Format (ATIF)
    • Agent Trajectory Observability Format (ATOF)
    • OpenTelemetry
    • OpenInference
  • Adaptive Plugin
    • About
    • Configuration
    • Adaptive Cache Governor (ACG)
    • Adaptive Hints
  • NeMo Guardrails Plugin
    • About
    • Configuration
  • Integrate into Frameworks
    • About
    • Adding Scopes
    • Wrap Tool Calls
    • Wrap LLM Calls
    • Handle Non-Serializable Data
    • Using Codecs
    • Provider Codecs
    • Provider Response Codecs
    • Code Examples
  • Build Plugins
    • About
    • Define a Plugin
    • Validate Plugin Configuration
    • Plugin Configuration Files
    • Register Plugin Behavior
    • Design Plugin Configuration
    • NeMo Guardrails Example Plugin
    • Code Examples
  • Contribute
    • About
    • Development Setup
    • Workflow and Reviews
    • Testing and Documentation
  • Reference
    • APIs
      • Python Library Reference
      • Node.js Library Reference
      • Rust Library Reference
        • nemo-relay
        • nemo-relay-adaptive
          • acg
            • anthropic_plugin
            • canonicalize
            • capability
            • ir_builder
            • openai_plugin
            • passthrough
            • plugin
            • plugin_registry
            • policy
            • profile
            • prompt_ir
            • retention
            • stability
            • telemetry
            • types
              • AgentIdentity
              • CacheStabilityIntent
              • CompressionIntent
              • ContentExtractionIntent
              • IntentOutcome
              • ModelRoutingIntent
              • OptimizationIntentBundle
              • PlacementIntent
              • PriorityIntent
              • RetentionIntent
              • SerializationIntent
              • ToolScopeIntent
              • TranslationReport
              • IntentType
              • ModelClass
              • OptimizationIntent
              • PlacementTarget
              • ReasonCode
              • RetentionTier
              • SharingScope
              • TranslationStatus
            • variable_extractor
            • error
            • MIN_ACG_OBSERVATIONS
          • acg_component
          • acg_learner
          • acg_profile
          • adaptive_hints_intercept
          • cache_diagnostics
          • config
          • context_helpers
          • drain
          • error
          • intercepts
          • learner
          • plugin_component
          • redis
          • storage
          • subscriber
          • tool_parallelism_learner
          • trie
          • types
          • AdaptiveRuntime
        • nemo-relay-ffi
    • Performance
  • Resources
    • Support and FAQs
    • Glossary
    • Troubleshooting Guide
    • Community
    • Legal
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogo
On this page
  • Structs
  • Enums
ReferenceAPIsRust Library Referencenemo-relay-adaptiveacg

Module types

||View as Markdown|
Previous

Enum Cache Telemetry Provider

Next

Struct Agent Identity

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

Core data types for the Adaptive Cache Governor (ACG) crate.

This module defines the vocabulary types used by the Adaptive Cache Governor (ACG) system: OptimizationIntent enum with 9 variants, per-variant payload structs, OptimizationIntentBundle, AgentIdentity, and supporting enums (SharingScope, RetentionTier, PlacementTarget, ModelClass, IntentType).

All types derive serde::Serialize and serde::Deserialize so they can be round-tripped through JSON without loss.

Structs

  • AgentIdentity: Identity model for an agent type.
  • CacheStabilityIntent: Cache stability analysis results for a prompt region.
  • CompressionIntent: Content compression intent.
  • ContentExtractionIntent: Content extraction intent for variable content detection.
  • IntentOutcome: Records the outcome of translating a single optimization intent.
  • ModelRoutingIntent: Model routing and selection intent.
  • OptimizationIntentBundle: A bundle of optimization intents for a single request.
  • PlacementIntent: Context placement optimization intent.
  • PriorityIntent: Latency and priority routing intent.
  • RetentionIntent: Cache retention policy intent.
  • SerializationIntent: Serialization and fanout optimization intent.
  • ToolScopeIntent: Tool scope and phase management intent.
  • TranslationReport: A plugin’s complete report on how it handled an intent bundle.

Enums

  • IntentType: Discriminant enum for intent types (used in translation report outcomes).
  • ModelClass: Model complexity/criticality class for routing.
  • OptimizationIntent: A single optimization intent emitted by a behavioral model.
  • PlacementTarget: Target location for context placement.
  • ReasonCode: Machine-readable reason for the translation outcome.
  • RetentionTier: Retention tier for cached state.
  • SharingScope: Sharing scope for cached content - stability does not imply shareability. Default is Session per security requirements.
  • TranslationStatus: Outcome status for a single intent translation.