Sparse Attention
These pages describe attention APIs with selected tokens, blocks, or masks, and related compression operations. The APIs are experimental and subject to change.
See Attention for scaled dot-product attention and Linear Attention for recurrent attention APIs.