DistributedContext#

class nvmath.distributed.DistributedContext( device_id: int, process_group: ProcessGroup, nvshmem_available: bool, nccl_comm: Any | None, )[source]#

Context of initialized nvmath.distributed runtime.

device_id#

CUDA device ID associated with the distributed runtime on this process.

Type:: int

process_group#

nvmath.distributed participating processes.

Type:: nvmath.distributed.process_group.ProcessGroup

nvshmem_available#

True if NVSHMEM backend was selected at initialization.

Type:: bool

nccl_comm#

nccl4py communicator if NCCL backend was selected at initialization, None otherwise.

Type:: Any | None