> This page is for NeMo Relay, version v0.8.4.
> For other versions, use one of these documentation indexes:
> - Latest (v0.10.0) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
> - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
> - v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
> - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
> - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
> - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
> - v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
> - v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Module response_cache

> Opt-in exact-match LLM response and tool-result cache. Opt-in exact-match cache for LLM responses and tool results: a feature of the adaptive plugin, configured through `crate::config::AdaptiveConfig::response_cache`.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

Opt-in exact-match LLM response and tool-result cache. Opt-in exact-match cache for LLM responses and tool results: a feature of the adaptive plugin, configured through [`crate::config::AdaptiveConfig::response_cache`](/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-adaptiveconfig).

The two surfaces share storage but use disjoint keys.

\[`intercept`] holds the execution intercepts and storage rules, \[`key`] the cache-key derivation, \[`store`] the backends, \[`replay`] the streaming replay, and \[`mark`] the observability surface.

## Re-exports

* `pub use crate::config::ResponseCacheConfig;`
* `pub use crate::response_cache::config::BackendConfig;`
* `pub use crate::response_cache::config::KEY_STRATEGY_EXACT_REQUEST;`
* `pub use crate::response_cache::config::ToolCacheConfig;`

## Modules

* [config](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config): Backend selection for the adaptive plugin's `response_cache` feature.

## Constants

* [RESPONSE\_CACHE\_MARK](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/constant-response-cache-mark): Mark-event name emitted on every cache decision.