> This page is for NeMo Relay, version v0.9.4.
> For other versions, use one of these documentation indexes:
> - Latest (v0.10.0) (default): https://docs.nvidia.com/nemo/relay/latest/llms.txt
> - dev: https://docs.nvidia.com/nemo/relay/dev/llms.txt
> - v0.10.0: https://docs.nvidia.com/nemo/relay/v0.10.0/llms.txt
> - v0.9.4: https://docs.nvidia.com/nemo/relay/v0.9.4/llms.txt
> - v0.8.4: https://docs.nvidia.com/nemo/relay/v0.8.4/llms.txt
> - v0.7.3: https://docs.nvidia.com/nemo/relay/v0.7.3/llms.txt
> - v0.6.0: https://docs.nvidia.com/nemo/relay/v0.6.0/llms.txt
> - v0.5.0: https://docs.nvidia.com/nemo/relay/v0.5.0/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/relay/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server.

# Module config

> Backend selection for the adaptive plugin's `response_cache` feature.

Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`.

Backend selection for the adaptive plugin's `response_cache` feature.

The `response_cache` section struct ([`crate::config::ResponseCacheConfig`](/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-responsecacheconfig)) lives in [`crate::config`](/reference/api/rust-library-reference/nemo-relay-adaptive/config) alongside the other `AdaptiveConfig` sections (`acg`, `adaptive_hints`, `tool_parallelism`). This module keeps the response-cache-specific backend config and the key-strategy constant next to the key/store code that consumes them.

## Structs

* [BackendConfig](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-backendconfig): Backend selection mirroring the adaptive [`crate::config::BackendSpec`](/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-backendspec) shape.
* [ToolCacheConfig](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolcacheconfig): Opt-in tool-result cache configuration.
* [ToolClass](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolclass): Policy shared by a class of tools.
* [ToolOverride](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-tooloverride): Per-tool refinement applied after class resolution.

## Enums

* [ResponseCacheKeyStrategy](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/enum-responsecachekeystrategy): Strategy for deriving an LLM response-cache key.

## Constants

* [DEFAULT\_MAX\_BYTES](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/constant-default-max-bytes): Default in-memory byte budget: 256 MiB.