> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Struct HotCache

> In-memory cache of adaptive artifacts needed on the hot path.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

<pre />

In-memory cache of adaptive artifacts needed on the hot path.

The adaptive runtime keeps this structure in an [`std::sync::RwLock`](https://doc.rust-lang.org/1.93.0/std/sync/poison/rwlock/struct.RwLock.html) so intercepts and event-processing tasks can exchange recently learned plans, trie state, and Adaptive Cache Governor (ACG) summaries without hitting the configured backend on every request.

## Fields

### `plan: Option<ExecutionPlan>`

Current execution plan used for tool parallelism hints.

### `trie: Option<PredictionTrieNode>`

Prediction trie used to derive default latency sensitivity hints.

### `agent_hints_default: Option<AgentHints>`

Default agent-level hints computed from the prediction trie.

### `acg_profiles: HashMap<String, StabilityAnalysisResult>`

Per-profile ACG stability results keyed by derived profile identifier.

### `acg_profile_observation_counts: HashMap<String, u32>`

Observation counts corresponding to entries in [`Self::acg_profiles`](/reference/api/rust-library-reference/nemo-relay-adaptive/types/cache/struct-hotcache).

### `acg_stability: Option<StabilityAnalysisResult>`

Aggregate ACG stability result used for warm-first eligibility checks.

### `acg_observation_count: u32`

Observation count associated with [`Self::acg_stability`](/reference/api/rust-library-reference/nemo-relay-adaptive/types/cache/struct-hotcache).

## Trait Implementations

### `impl Clone for HotCache`

<pre />

#### `clone`

<pre />

#### `clone_from`

<pre />

### `impl Debug for HotCache`

<pre />

#### `fmt`

<pre />

### `impl<'de> Deserialize<'de> for HotCache`

<pre />

#### `deserialize`

<pre />

### `impl Serialize for HotCache`

<pre />

#### `serialize`

<pre />