> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Module response_cache

> Opt-in exact-match LLM response and tool-result cache. Opt-in cache for LLM responses and tool results: a feature of the adaptive plugin, configured through `crate::config::AdaptiveConfig::response_cache`.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

Opt-in exact-match LLM response and tool-result cache. Opt-in cache for LLM responses and tool results: a feature of the adaptive plugin, configured through [`crate::config::AdaptiveConfig::response_cache`](/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-adaptiveconfig).

The two surfaces share storage but use disjoint keys.

\[`intercept`] holds the execution intercepts and storage rules, \[`key`] the cache-key derivation, \[`store`] the backends, \[`replay`] the streaming replay, and \[`mark`] the observability surface.

## Re-exports

* `pub use crate::config::ResponseCacheConfig;`
* `pub use crate::response_cache::config::BackendConfig;`
* `pub use crate::response_cache::config::ResponseCacheKeyStrategy;`
* `pub use crate::response_cache::config::ToolCacheConfig;`

## Modules

* [config](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config): Backend selection for the adaptive plugin's `response_cache` feature.

## Constants

* [RESPONSE\_CACHE\_MARK](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/constant-response-cache-mark): Mark-event name emitted on every cache decision.

> Opt-in exact-match LLM response and tool-result cache. Opt-in cache for LLM responses and tool results: a feature of the adaptive plugin, configured through `crate::config::AdaptiveConfig::response_cache`.

## Docs

- [Module config](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config.md): Backend selection for the adaptive plugin's `response_cache` feature.
- [Struct Backend Config](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-backendconfig.md): Backend selection mirroring the adaptive `crate::config::BackendSpec` shape.
- [Enum Response Cache KeyStrategy](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/enum-responsecachekeystrategy.md): Strategy for deriving an LLM response-cache key.
- [Struct Tool Class](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolclass.md): Policy shared by a class of tools.
- [Struct Tool Cache Config](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolcacheconfig.md): Opt-in tool-result cache configuration.
- [Struct Tool Override](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-tooloverride.md): Per-tool refinement applied after class resolution.
- [Constant DEFAULT_MAX_BYTES](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/constant-default-max-bytes.md): Default in-memory byte budget: 256 MiB.
- [Constant RESPONSE_CACHE_MARK](https://docs.nvidia.com/nemo/relay/v0.10.0/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/constant-response-cache-mark.md): Mark-event name emitted on every cache decision.