nemo_curator.backends.internal.raft.ray_comms

Module Contents

Classes

Name	Description
`Comms`	Initializes and manages underlying NCCL comms handles across the a pool of

API

class nemo_curator.backends.internal.raft.ray_comms.Comms(
    verbose: bool = False,
    nccl_root_location: str = 'ray-actor'
)

Initializes and manages underlying NCCL comms handles across the a pool of Ray actors. It is expected that init() will be called explicitly. It is recommended to also call destroy() when the comms are no longer needed so the underlying resources can be cleaned up. This class is not meant to be thread-safe.

nccl_root_location

= nccl_root_location.lower()

sessionId

= uuid.uuid4().bytes

valid_nccl_placements

= 'ray-actor'

nemo_curator.backends.internal.raft.ray_comms.Comms.__del__() -> None

nemo_curator.backends.internal.raft.ray_comms.Comms.create_nccl_uniqueid() -> None

nemo_curator.backends.internal.raft.ray_comms.Comms.init() -> None

Initializes the underlying comms.