nat.middleware.cache.cache_middleware_config#

Configuration for cache middleware.

Classes#

CacheMiddlewareConfig

Configuration for cache middleware.

Module Contents#

class CacheMiddlewareConfig(/, **data: Any)#

Bases: nat.data_models.middleware.FunctionMiddlewareBaseConfig

Configuration for cache middleware.

The cache middleware memoizes function outputs based on input similarity, with support for both exact and fuzzy matching.

Args:
enabled_mode: Controls when caching is active:

  • “always”: Cache is always enabled

  • “eval”: Cache only active when Context.is_evaluating is True

similarity_threshold: Float between 0 and 1 for input matching:

  • 1.0: Exact string matching (fastest)

  • < 1.0: Fuzzy matching using difflib similarity

Create a new model by parsing and validating input data from keyword arguments.

Raises [ValidationError][pydantic_core.ValidationError] if the input data cannot be validated to form a valid model.

self is explicitly positional-only to allow self as a field name.

enabled_mode: Literal['always', 'eval'] = None#
similarity_threshold: float = None#