cuBLASMp Initialization

Overview

cuBLASMp requires the user to initialize the NCCL communicator before passing it to cuBLASMp functions. The steps are covered in the NCCL documentation and briefly described in the NCCL Initialization section of this documentation.

cuBLASMp versions prior to v0.5.0 used CAL. For users who are migrating from CAL to NCCL, the Migrating from CAL to NCCL section of this documentation provides the steps to migrate.

For users maintaining those older releases, the CAL Initialization (Legacy) section is kept as archival reference only. Current releases use ncclComm_t with cublasMpGridCreate.

Contents

cuBLASMp Initialization

• NCCL Initialization
• Migrating from CAL to NCCL
• CAL Initialization (Legacy)