> This page is for version 0.7.0 · 26.10.
> For other versions, use one of these documentation indexes:
> - Nightly (default): https://docs.nvidia.com/nemo/automodel/nightly/llms.txt
> - Latest: https://docs.nvidia.com/nemo/automodel/latest/llms.txt
> - 0.7.0 · 26.10: https://docs.nvidia.com/nemo/automodel/v0.7/llms.txt
> - 0.5.0 · 26.06: https://docs.nvidia.com/nemo/automodel/v0.5/llms.txt
> - 0.4.0 · 26.04: https://docs.nvidia.com/nemo/automodel/v0.4/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.

# nemo_automodel.components.models.qwen3_8_flash_next.parallelization

Distributed-parallelization registration for Qwen3.8-Flash-Next.

## Module Contents

### Classes

| Name                                                                                                                                            | Description                                                                    |
| ----------------------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------ |
| [`Qwen3_8_FlashNextModelParallelizer`](#nemo_automodel-components-models-qwen3_8_flash_next-parallelization-Qwen3_8_FlashNextModelParallelizer) | Reject dense FSDP2 for PLE checkpoints, which never binds the PLE owner group. |

### Data

[`PARALLELIZER`](#nemo_automodel-components-models-qwen3_8_flash_next-parallelization-PARALLELIZER)

### API

```python
class nemo_automodel.components.models.qwen3_8_flash_next.parallelization.Qwen3_8_FlashNextModelParallelizer()
```

**Bases:** `ModelParallelizer`

Reject dense FSDP2 for PLE checkpoints, which never binds the PLE owner group.

```python
nemo_automodel.components.models.qwen3_8_flash_next.parallelization.Qwen3_8_FlashNextModelParallelizer._apply(
    model: torch.nn.Module,
    device_mesh: torch.distributed.device_mesh.DeviceMesh,
    kwargs = {}
) -> torch.nn.Module
```

Apply dense FSDP2, which the shared dispatch selects only for `ep_size == 1`.

Only the MoE parallelizer (`ep_size &gt; 1`) binds the PLE table's owner
group to the stage's data/context shard mesh. The check reads the
config rather than the stage's modules, so every pipeline stage raises
together instead of only the stage that holds the table.

**Parameters:**

**`model`** `nn.Module`

Qwen3.8-Flash-Next model or pipeline stage.

---

**`device_mesh`** `DeviceMesh`

Device mesh of the dense FSDP2 path.

---

**`**kwargs`** — default: \{}

Remaining arguments of `ModelParallelizer._apply`.

---

**Returns:** `nn.Module`

The parallelized model.

```python
nemo_automodel.components.models.qwen3_8_flash_next.parallelization.PARALLELIZER = Qwen3_8_FlashNextModelParallelizer()
```