core.ssm.ops.gdp#
Inference-only fork of the Gated Delta Product kernels from
flash-linear-attention <https://github.com/fla-org/flash-linear-attention>_
(v0.5.1).
Training and the static-batching inference path call the pip
flash-linear-attention kernels, which own the backward pass. Only the
dynamic-batching decode and prefill steps route here:
fused_recurrent_gated_delta_rule_update– decode.gdp_decode_prepare– the reshape/gating step feeding decode.chunk_gated_delta_product_varlen– prefill.
All entry points are forward-only.
Submodules#
Package Contents#
Data#
API#
- core.ssm.ops.gdp.__all__#
[‘chunk_gated_delta_product_varlen’, ‘fused_recurrent_gated_delta_rule_update’, ‘gdp_decode_prepare’…