Is this page helpful?

`core.distributed.fsdp.src.megatron_fsdp.experimental.schedule`#

Scheduling configuration for the minimal Megatron-FSDP path.

Module Contents#

Classes#

SchedulePolicy

Control communication scheduling for one FSDP module.

API#

class core.distributed.fsdp.src.megatron_fsdp.experimental.schedule.SchedulePolicy#

Control communication scheduling for one FSDP module.

None prefetches one successor, preserving the default behavior. 0 disables prefetching. Positive values specify parameter-element budgets.

forward_prefetch_size: int | None#: None

backward_prefetch_size: int | None#: None

__post_init__() → None#: Validate non-negative prefetch budgets.