Is this page helpful?

`core.distributed.fsdp.src.megatron_fsdp.experimental.phase`#

Lifecycle phases of the minimal Megatron-FSDP path.

Module Contents#

Classes#

Lifecycle phase of an FsdpModule.

API#

class core.distributed.fsdp.src.megatron_fsdp.experimental.phase.Phase(*args, **kwds)#

Bases: enum.Enum

Lifecycle phase of an FsdpModule.

Initialization

RESTING#: ‘auto(…)’

FORWARD#: ‘auto(…)’

BACKWARD#: ‘auto(…)’