nemo_automodel.components.models.qwen3_8_flash_next.backend

Deprecated Qwen3.8-Flash-Next backend config, kept so existing YAML _target_ paths still load.

Module Contents

Classes

Name	Description
`Qwen3_8_FlashNextBackendConfig`	Deprecated alias of `BackendConfig` for Qwen3.8-Flash-Next.

Data

logger

API

class nemo_automodel.components.models.qwen3_8_flash_next.backend.Qwen3_8_FlashNextBackendConfig(
    attn: typing.Literal['te', 'sdpa', 'flex', 'eager', 'tilelang', 'cudnn', 'fa4', 'cute'] = BackendConfig.attn,
    sparse_attn: typing.Literal['generic', 'msa'] = 'generic',
    linear: typing.Literal['torch', 'te', 'quack'] = 'te' if HAVE_TE and torch.c...,
    rms_norm: typing.Literal['torch', 'torch_fp32', 'te', 'quack'] = 'torch_fp32',
    rope: typing.Literal['torch', 'quack', 'triton'] = 'torch',
    rope_fusion: bool = HAVE_TE and torch.cuda.is_a...,
    experts: typing.Literal['torch', 'te', 'gmm', 'torch_mm', 'torch_mm_mxfp8'] = 'torch_mm' if torch.cuda.is...,
    dispatcher: typing.Literal['torch', 'deepep', 'hybridep', 'uccl_ep', 'mok'] = 'deepep' if HAVE_DEEP_EP an...,
    te_grouped_tensor: bool = False,
    dispatcher_num_sms: int = 20,
    dispatcher_share_token_dispatcher: bool = True,
    dispatcher_async_dispatch: bool = False,
    dispatcher_capacity_factor: float | None = None,
    dispatcher_equal_token_counts: bool = False,
    dispatcher_recompute_cache: str = 'none',
    mok: nemo_automodel.components.models.common.utils.MoKBackendConfig = MoKBackendConfig(),
    dispatcher_hybridep_permute_fusion: bool = False,
    dispatcher_hybridep_compact_routing: bool = False,
    dispatcher_hybridep_num_sms_preprocessing: int | None = None,
    dispatcher_hybridep_num_blocks_permute: int | None = None,
    dispatcher_hybridep_num_blocks_unpermute: int | None = None,
    dispatcher_hybridep_max_tokens_per_rank: int | None = None,
    enable_deepep: bool | None = None,
    fake_balanced_gate: bool = False,
    fake_gate_noise: float = 0.0,
    enable_hf_state_dict_adapter: bool = True,
    enable_fsdp_optimizations: bool = False,
    te_fp8: nemo_automodel.components.models.common.utils.TEFp8Config | None = None,
    gate_precision: str | torch.dtype | None = None,
    compile_attn: bool = False,
    compile_situ: bool = False,
    compile_norm: bool = False,
    compile_hc: bool = False,
    shared_expert_overlap: bool = False,
    compile_router_weight: bool = False,
    benchmark_static_routing: bool = False,
    cuda_graph: nemo_automodel.components.models.common.utils.CudaGraphConfig = CudaGraphConfig()
)

Dataclass

Bases: BackendConfig

Deprecated alias of BackendConfig for Qwen3.8-Flash-Next.

FA4 QSA is now selected with the shared BackendConfig(attn="fa4") and cuDNN indexed QSA with BackendConfig(attn="cudnn"). This class only keeps YAMLs that target nemo_automodel.components.models.qwen3_8_flash_next.backend.Qwen3_8_FlashNextBackendConfig working: the former attn="cute" is translated to "fa4" with a migration warning. All other settings are inherited.

attn

Literal['te', 'sdpa', 'flex', 'eager', 'tilelang', 'cudnn', 'fa4', 'cute'] = BackendConfig.attn

nemo_automodel.components.models.qwen3_8_flash_next.backend.Qwen3_8_FlashNextBackendConfig.__post_init__() -> None

nemo_automodel.components.models.qwen3_8_flash_next.backend.logger = logging.getLogger(__name__)