nemo_automodel.components.distributed.context_parallel
nemo_automodel.components.distributed.context_parallel
Context-parallel batch sharding.
Submodules
nemo_automodel.components.distributed.context_parallel.maginemo_automodel.components.distributed.context_parallel.mambanemo_automodel.components.distributed.context_parallel.shardernemo_automodel.components.distributed.context_parallel.utils