core.distributed.fsdp

Subpackages

• core.distributed.fsdp.src
  • core.distributed.fsdp.src.megatron_fsdp
    • core.distributed.fsdp.src.megatron_fsdp.param_and_grad_buffer
    • core.distributed.fsdp.src.megatron_fsdp.distributed_data_parallel_config
    • core.distributed.fsdp.src.megatron_fsdp.fully_shard
    • core.distributed.fsdp.src.megatron_fsdp.megatron_fsdp
    • core.distributed.fsdp.src.megatron_fsdp.uneven_dtensor
    • core.distributed.fsdp.src.megatron_fsdp.package_info
    • core.distributed.fsdp.src.megatron_fsdp.utils

Submodules

• core.distributed.fsdp.mcore_fsdp_adapter