Is this page helpful?

core.resharding.execution#

Module Contents#

Functions#

_is_mxfp8_tensor

Check if param is a TE MXFP8Tensor (fp8_param=true).

execute_reshard_plan

Execute a reshard plan (from centralized controller). A communication service must be provided to abstract transport. Expected service API: submit_send(tensor, dest_rank), submit_recv(tensor, src_rank), run().

Data#

logger

API#

core.resharding.execution.logger#

‘getLogger(…)’

core.resharding.execution._is_mxfp8_tensor(param)#

Check if param is a TE MXFP8Tensor (fp8_param=true).

core.resharding.execution.execute_reshard_plan(
plan: core.resharding.utils.ReshardPlan,
src_module: torch.nn.Module,
dst_module: torch.nn.Module,
service: core.resharding.copy_services.base.CopyService,
group=None,
transform: Optional[core.resharding.transforms.ReshardTransform] = None,
) → None#

Execute a reshard plan (from centralized controller). A communication service must be provided to abstract transport. Expected service API: submit_send(tensor, dest_rank), submit_recv(tensor, src_rank), run().

Supports None for src_module and/or dst_module to allow ranks in non-collocated mode:

  • src_module=None: Rank only receives data (destination-only)

  • dst_module=None: Rank only sends data (source-only)

  • Both provided: Rank participates in both send and recv (collocated mode)

When transform is provided, parameters for which transform.should_transform(param_name) returns True use the transform’s prepare_send / prepare_recv / finalize_recv methods instead of the default slice-and-copy logic.