> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/llms.txt. > For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/relay/_mcp/server. # Module config > Backend selection for the adaptive plugin's `response_cache` feature. Generated from `cargo doc --no-deps -p nemo-relay -p nemo-relay-adaptive -p nemo-relay-pii-redaction -p nemo-relay-ffi -p nemo-relay-types -p nemo-relay-plugin -p nemo-relay-worker-proto -p nemo-relay-worker`. Backend selection for the adaptive plugin's `response_cache` feature. The `response_cache` section struct ([`crate::config::ResponseCacheConfig`](/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-responsecacheconfig)) lives in [`crate::config`](/reference/api/rust-library-reference/nemo-relay-adaptive/config) alongside the other `AdaptiveConfig` sections (`acg`, `adaptive_hints`, `tool_parallelism`). This module keeps the response-cache-specific backend config and the key-strategy constant next to the key/store code that consumes them. ## Structs * [BackendConfig](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-backendconfig): Backend selection mirroring the adaptive [`crate::config::BackendSpec`](/reference/api/rust-library-reference/nemo-relay-adaptive/config/struct-backendspec) shape. * [ToolCacheConfig](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolcacheconfig): Opt-in tool-result cache configuration. * [ToolClass](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolclass): Policy shared by a class of tools. * [ToolOverride](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-tooloverride): Per-tool refinement applied after class resolution. ## Enums * [ResponseCacheKeyStrategy](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/enum-responsecachekeystrategy): Strategy for deriving an LLM response-cache key. ## Constants * [DEFAULT\_MAX\_BYTES](/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/constant-default-max-bytes): Default in-memory byte budget: 256 MiB. > Backend selection for the adaptive plugin's `response_cache` feature. ## Docs - [Struct Backend Config](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-backendconfig.md): Backend selection mirroring the adaptive `crate::config::BackendSpec` shape. - [Enum Response Cache KeyStrategy](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/enum-responsecachekeystrategy.md): Strategy for deriving an LLM response-cache key. - [Struct Tool Class](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolclass.md): Policy shared by a class of tools. - [Struct Tool Cache Config](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-toolcacheconfig.md): Opt-in tool-result cache configuration. - [Struct Tool Override](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/struct-tooloverride.md): Per-tool refinement applied after class resolution. - [Constant DEFAULT_MAX_BYTES](https://docs.nvidia.com/nemo/relay/v0.9.4/reference/api/rust-library-reference/nemo-relay-adaptive/response_cache/config/constant-default-max-bytes.md): Default in-memory byte budget: 256 MiB.