HPC-X General Support

The platform and requirements for HPC-X are detailed in the following table:

Platform

Drivers and HCAs

OFED/MLNX_OFED

  • NVIDIA® MLNX_OFED 5.0-x.x.x.x and above

HCAs

  • NVIDIA® BlueField®-2

  • NVIDIA® ConnectX®-7

  • NVIDIA® ConnectX®-6 Lx

  • NVIDIA® ConnectX®-6 Dx

  • NVIDIA® ConnectX®-6

  • NVIDIA® ConnectX®-5/ConnectX®-5 Ex

  • NVIDIA® ConnectX®-4 Lx

  • NVIDIA® ConnectX®-4

  • NVIDIA® ConnectX®-3 Pro

  • NVIDIA® ConnectX®-3

  • NVIDIA® ConnectX-IB®

The following communications libraries and acceleration packages are part of this Mellanox HPC-X® package:

Library/Acceleration Package

Version Number

Open MPI

4.1.x

Mellanox Scalable Hierarchical Aggregation and Reduction Protocol (SHARP)

2.6

HCOLL

4.7

UCX

1.14

UCC

1.0

Open SHMEM specification compliance

1.41

ClusterKit2

1.6

nccl-rdma-sharp-plugin3

2.1

  1. Full Open SHMEM v1.4 support is available only if compiled with C11 Standard (see Rebuilding Open MPI from HPC-X™ Sources).

  2. ClusterKit is a multifaceted node assessment tool for high performance clusters.

  3. nccl-rdma-sharp plugin enables RDMA and Switch-based collectives (SHARP) with NVIDIA's NCCL library.

Warning

When HPC-X is launched with Open MPI without a resource manager job environment (slurm,pbs, etc.), or when it is launched from a compute node, the default rsh/ssh-based launcher will be used. This launcher does not propagate environment variables to the compute nodes. Thus, it is important to ensure the propagation of LD_LIBRARY_PATH variable from HPC-x is done as follows.

Copy
Copied!
            

%mpirun -x LD_LIBRARY_PATH -np 2 -H host1,host2 $HPCX_MPI_TESTS_DIR/examples/hello_c

The following table lists the supported operating systems and CPUs for the latest HPC-X.

Warning

Starting from HPC-X v2.9, HPC-X will no longer support PPC architecture.

Operating System

Platforms

RHEL/CentOS 7.2

x86_64

RHEL/CentOS 7.3

x86_64

RHEL/CentOS 7.4

x86_64

RHEL/CentOS 7.5

x86_64

RHEL/CentOS 7.6

x86_64

RHEL7.7/CentOS 7.7

x86_64

RHEL7.8/CentOS 7.8

x86_64

RHEL7.9/CentOS 7.9

x86_64

RHEL/CentOS 8.0

x86_64, AArch64

RHEL/CentOS 8.1

x86_64, AArch64

RHEL/CentOS 8.2

x86_64, AArch64

RHEL8.3/CentOS 8.3

x86_64, AArch64

SLES 12 SP4

x86_64, AArch64

SLES 12 SP5

x86_64

SLES 15 SP1

x86_64

SLES 15 SP2

x86_64

SLES 15 SP3

x86_64

Ubuntu 16.04

x86_64

Ubuntu 18.04

x86_64

Ubuntu 20.04

x86_64, AArch64

Ubuntu 21.04

x86_64

OpenEuler 20.03

x86_64, AArch64

Kylin 10 SP1

x86_64, AArch64

© Copyright 2023, NVIDIA. Last updated on May 23, 2023.