core.resharding.execution

Module Contents

Functions

execute_reshard_plan

Execute a reshard plan (from centralized controller). A communication service must be provided to abstract transport. Expected service API: submit_send(tensor, dest_rank), submit_recv(tensor, src_rank), run().

Data

logger

API

core.resharding.execution.logger

‘getLogger(…)’

core.resharding.execution.execute_reshard_plan(

plan: core.resharding.utils.ReshardPlan,

src_module: torch.nn.Module,

dst_module: torch.nn.Module,

service: core.resharding.copy_services.base.CopyService,

) → None

Execute a reshard plan (from centralized controller). A communication service must be provided to abstract transport. Expected service API: submit_send(tensor, dest_rank), submit_recv(tensor, src_rank), run().