Is this page helpful?

core.resharding.copy_services.nccl_copy_service#

Module Contents#

Classes#

NCCLCopyService

Thin wrapper around torch.distributed batch_isend_irecv to submit and execute a batch of point-to-point sends and recvs.

Data#

logger

API#

core.resharding.copy_services.nccl_copy_service.logger#

‘getLogger(…)’

class core.resharding.copy_services.nccl_copy_service.NCCLCopyService(group=None)#

Bases: core.resharding.copy_services.base.CopyService

Thin wrapper around torch.distributed batch_isend_irecv to submit and execute a batch of point-to-point sends and recvs.

Initialization

submit_send(
src_tensor: torch.Tensor,
dest_rank: int,
task_id: Optional[int] = None,
)#
submit_recv(
dest_tensor: torch.Tensor,
src_rank: int,
task_id: Optional[int] = None,
)#
run()#