Module types | NVIDIA NeMo Relay

Generated from cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-ffi.

Core data types for the Adaptive Cache Governor (ACG) crate.

This module defines the vocabulary types used by the Adaptive Cache Governor (ACG) system: OptimizationIntent enum with 9 variants, per-variant payload structs, OptimizationIntentBundle, AgentIdentity, and supporting enums (SharingScope, RetentionTier, PlacementTarget, ModelClass, IntentType).

All types derive serde::Serialize and serde::Deserialize so they can be round-tripped through JSON without loss.

Structs

AgentIdentity: Identity model for an agent type.
CacheStabilityIntent: Cache stability analysis results for a prompt region.
CompressionIntent: Content compression intent.
ContentExtractionIntent: Content extraction intent for variable content detection.
IntentOutcome: Records the outcome of translating a single optimization intent.
ModelRoutingIntent: Model routing and selection intent.
OptimizationIntentBundle: A bundle of optimization intents for a single request.
PlacementIntent: Context placement optimization intent.
PriorityIntent: Latency and priority routing intent.
RetentionIntent: Cache retention policy intent.
SerializationIntent: Serialization and fanout optimization intent.
ToolScopeIntent: Tool scope and phase management intent.
TranslationReport: A plugin’s complete report on how it handled an intent bundle.

IntentType: Discriminant enum for intent types (used in translation report outcomes).
ModelClass: Model complexity/criticality class for routing.
OptimizationIntent: A single optimization intent emitted by a behavioral model.
PlacementTarget: Target location for context placement.
ReasonCode: Machine-readable reason for the translation outcome.
RetentionTier: Retention tier for cached state.
SharingScope: Sharing scope for cached content - stability does not imply shareability. Default is Session per security requirements.
TranslationStatus: Outcome status for a single intent translation.