core.resharding.nvshmem_copy_service

NVSHMEM-based remote copy service and supporting components.

This package is an in-tree integration of the standalone nvshmem_copy_service/python implementation so that Megatron can use it without relying on an external library.

Subpackages

• core.resharding.nvshmem_copy_service.planning
  • core.resharding.nvshmem_copy_service.planning.task_segmenter
  • core.resharding.nvshmem_copy_service.planning.workload_packer
  • core.resharding.nvshmem_copy_service.planning.gpu_execution_planner
  • core.resharding.nvshmem_copy_service.planning.communication_scheduler
• core.resharding.nvshmem_copy_service.memory
  • core.resharding.nvshmem_copy_service.memory.tensor_pointer_utils
  • core.resharding.nvshmem_copy_service.memory.double_buffer_manager
• core.resharding.nvshmem_copy_service.core
  • core.resharding.nvshmem_copy_service.core.pipeline_executor
  • core.resharding.nvshmem_copy_service.core.gpu_resource_manager
  • core.resharding.nvshmem_copy_service.core.kernel_launcher

Submodules

• core.resharding.nvshmem_copy_service.logger
• core.resharding.nvshmem_copy_service.service
• core.resharding.nvshmem_copy_service.nvshmem_types
• core.resharding.nvshmem_copy_service.validation

Package Contents

Data

__all__

API

core.resharding.nvshmem_copy_service.__all__

[‘RemoteCopyService’, ‘nvshmem_types’, ‘GPUResourceManager’, ‘KernelLauncher’, ‘PipelineExecutor’, ‘…