`nemo_automodel._transformers.utils`#

Module Contents#

`sliding_window_overwrite`	Returns configuration overrides to handle sliding window settings based on model rules.
`apply_cache_compatibility_patches`	Apply compatibility patches for transformers cache utilities.

nemo_automodel._transformers.utils.sliding_window_overwrite(model_name: str) → dict[str, Any]#

Returns configuration overrides to handle sliding window settings based on model rules.

Parameters:: model_name – The HuggingFace model name or path to load configuration from
Returns:: Dictionary with overwrite values, or empty dict if no overwrites needed
Return type:: dict

nemo_automodel._transformers.utils.apply_cache_compatibility_patches()#: Apply compatibility patches for transformers cache utilities.