NVIDIA SHARP library is integrated into HCOLL collective library to offload collective operations in MPI applications.
The following basic flags should be used in environment to enable NVIDIA SHARP protocol in the HCOLL middleware. For the rest of flags, please refer to NVIDIA SHARP Release Notes.
HCOLL Library Flags
The following HCOLL flags can be used when running NVIDIA SHARP collective with mpirun utility.
NVIDIA SHARP coll logging level. Messages with a higher or equal level to the selected will be printed.
Number of nodes (node leaders) threshold in the communicator to create NVIDIA SHARP group and use NVIDIA SHARP collectives.
Number of unsuccessful polling loops in libsharp coll for blocking collective wait before calling user progress (HCOLL, OMPI).
Maximum allreduce size run through NVIDIA SHARP. A message size greater than the above the specified value by this parameter will fall back to non-SHARP-based algorithms (multicast based or non-multicast based).
The threshold is calculated based on the group resources.
Threshold = #OSTS * Payload_per_ost