Skip to navigation

nemo_automodel.shared.quack_patches

View as MarkdownOpen in Claude

quack-kernels compatibility patches for CuTe DSL kernels written against quack-kernels 0.6.4.

Module Contents

Functions

NameDescription
restore_quack_sub_packed_f32x2Bind quack.activation.sub_packed_f32x2 when the installed quack-kernels lacks it.

Data

_logger

API

nemo_automodel.shared.quack_patches.restore_quack_sub_packed_f32x2() -> None

Bind quack.activation.sub_packed_f32x2 when the installed quack-kernels lacks it.

quack-kernels 0.6.5 removed the helper; the CuTe DSL ships the same packed fp32x2 subtraction (round to nearest even unless rnd is given) as cutlass.cute.arch.sub_packed_f32x2. ffpa-attn 0.2.4 (its SM100 head-dim-512 forward) and the MSA revision the msa extra pins still call the quack name while their kernels are traced, so call this before they compile. It changes nothing when quack-kernels provides the helper or when quack or the DSL is missing.

nemo_automodel.shared.quack_patches._logger = logging.getLogger(__name__)