ReferenceFull Library ReferenceNemo AutomodelNemo AutomodelComponentsModelsGlm Moe DsaKernelsnemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd
nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd
nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd
This page is for version Nightly (default).
For other versions, use one of these documentation indexes:
- Nightly (default): https://docs.nvidia.com/nemo/automodel/nightly/llms.txt
- Latest: https://docs.nvidia.com/nemo/automodel/latest/llms.txt
- 0.7.0 · 26.10: https://docs.nvidia.com/nemo/automodel/v0.7/llms.txt
- 0.5.0 · 26.06: https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt
- 0.4.0 · 26.04: https://docs.nvidia.com/nemo/automodel/v0.4/llms.txt
Module Contents
Functions
| Name | Description |
|---|---|
clean_logits_ | - |
indexer_fwd_interface | - |
tl_indexer_fwd_impl | - |
API
nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd.clean_logits_(threads: int = 512,block_K: int = 4096)
nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd.indexer_fwd_interface(q,kv,weights,cu_seqlen_ks,cu_seqlen_ke,clean_logits = True)
nemo_automodel.components.models.glm_moe_dsa.kernels.tilelang_indexer_fwd.tl_indexer_fwd_impl(heads,index_dim,block_N = 256,num_stages = 3,threads = 512,block_Q = None)