> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# nemo_automodel.components.distributed

## Subpackages

* **[`nemo_automodel.components.distributed.pipelining`](/nemo-automodel/nemo_automodel/components/distributed/pipelining)**

## Submodules

* **[`nemo_automodel.components.distributed.activation_checkpointing`](/nemo-automodel/nemo_automodel/components/distributed/activation_checkpointing)**
* **[`nemo_automodel.components.distributed.config`](/nemo-automodel/nemo_automodel/components/distributed/config)**
* **[`nemo_automodel.components.distributed.cp_utils`](/nemo-automodel/nemo_automodel/components/distributed/cp_utils)**
* **[`nemo_automodel.components.distributed.ddp`](/nemo-automodel/nemo_automodel/components/distributed/ddp)**
* **[`nemo_automodel.components.distributed.fsdp2`](/nemo-automodel/nemo_automodel/components/distributed/fsdp2)**
* **[`nemo_automodel.components.distributed.grad_utils`](/nemo-automodel/nemo_automodel/components/distributed/grad_utils)**
* **[`nemo_automodel.components.distributed.init_utils`](/nemo-automodel/nemo_automodel/components/distributed/init_utils)**
* **[`nemo_automodel.components.distributed.magi_attn_utils`](/nemo-automodel/nemo_automodel/components/distributed/magi_attn_utils)**
* **[`nemo_automodel.components.distributed.mamba_cp`](/nemo-automodel/nemo_automodel/components/distributed/mamba_cp)**
* **[`nemo_automodel.components.distributed.megatron_fsdp`](/nemo-automodel/nemo_automodel/components/distributed/megatron_fsdp)**
* **[`nemo_automodel.components.distributed.mesh`](/nemo-automodel/nemo_automodel/components/distributed/mesh)**
* **[`nemo_automodel.components.distributed.mesh_utils`](/nemo-automodel/nemo_automodel/components/distributed/mesh_utils)**
* **[`nemo_automodel.components.distributed.optimized_tp_plans`](/nemo-automodel/nemo_automodel/components/distributed/optimized_tp_plans)**
* **[`nemo_automodel.components.distributed.parallel_styles`](/nemo-automodel/nemo_automodel/components/distributed/parallel_styles)**
* **[`nemo_automodel.components.distributed.parallelizer`](/nemo-automodel/nemo_automodel/components/distributed/parallelizer)**
* **[`nemo_automodel.components.distributed.parallelizer_utils`](/nemo-automodel/nemo_automodel/components/distributed/parallelizer_utils)**
* **[`nemo_automodel.components.distributed.tensor_utils`](/nemo-automodel/nemo_automodel/components/distributed/tensor_utils)**
* **[`nemo_automodel.components.distributed.thd_utils`](/nemo-automodel/nemo_automodel/components/distributed/thd_utils)**
* **[`nemo_automodel.components.distributed.utils`](/nemo-automodel/nemo_automodel/components/distributed/utils)**

## Package Contents

### Data

[`__all__`](#nemo_automodel-components-distributed-__all__)

### API

```python
nemo_automodel.components.distributed.__all__ = ['DDPConfig', 'DistributedSetup', 'DistInfo', 'FSDP2Config', 'MegatronFSDPConfig...
```