> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/automodel/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/automodel/_mcp/server.

# nemo_automodel.components.distributed.context_parallel

Context-parallel batch sharding.

## Submodules

* **[`nemo_automodel.components.distributed.context_parallel.magi`](/nemo-automodel/nemo_automodel/components/distributed/context_parallel/magi)**
* **[`nemo_automodel.components.distributed.context_parallel.mamba`](/nemo-automodel/nemo_automodel/components/distributed/context_parallel/mamba)**
* **[`nemo_automodel.components.distributed.context_parallel.sharder`](/nemo-automodel/nemo_automodel/components/distributed/context_parallel/sharder)**
* **[`nemo_automodel.components.distributed.context_parallel.utils`](/nemo-automodel/nemo_automodel/components/distributed/context_parallel/utils)**

## Package Contents

### Data

[`__all__`](#nemo_automodel-components-distributed-context_parallel-__all__)

### API

```python
nemo_automodel.components.distributed.context_parallel.__all__ = ['ContextParallelSharder']
```