core.distributed.fsdp.src.megatron_fsdp

Submodules

• core.distributed.fsdp.src.megatron_fsdp.param_and_grad_buffer
• core.distributed.fsdp.src.megatron_fsdp.distributed_data_parallel_config
• core.distributed.fsdp.src.megatron_fsdp.fully_shard
• core.distributed.fsdp.src.megatron_fsdp.megatron_fsdp
• core.distributed.fsdp.src.megatron_fsdp.uneven_dtensor
• core.distributed.fsdp.src.megatron_fsdp.package_info
• core.distributed.fsdp.src.megatron_fsdp.utils

Package Contents

Data

__all__

API

core.distributed.fsdp.src.megatron_fsdp.__all__

[‘DistributedDataParallelConfig’, ‘MegatronFSDP’, ‘FSDPDistributedIndex’, ‘fully_shard’, ‘fully_shar…