General Support
|
Operating System |
Architecture |
Default Kernel Version |
|
ALIOS7.2 |
AArch64 |
4.19.48-006.ali4000.alios7.aarch64 |
|
BCLINUX21.10SP2 |
AArch64 |
4.19.90-2107.6.0.0098.oe1.bclinux.aarch64 |
|
BCLINUX8.2 |
x86_64 |
4.19.0-240.23.11.el8_2.bclinux.x86_64 |
|
Debian10.8 |
AArch64 |
4.19.0-14-arm64 |
|
x86_64 |
4.19.0-14-amd64 |
|
|
Debian10.9 |
x86_64 |
4.19.0-16-amd64 |
|
Debian11.2 |
AArch64 |
5.10.0-10-arm64 |
|
x86_64 |
5.10.0-10-amd64 |
|
|
EulerOS2.0sp10 |
AArch64 |
4.19.90-vhulk2110.1.0.h860.eulerosv2r10.aarch64 |
|
x86_64 |
4.18.0-147.5.2.4.h694.eulerosv2r10.x86_64 |
|
|
EulerOS2.0sp9 |
AArch64 |
4.19.90-vhulk2006.2.0.h171.eulerosv2r9.aarch64 |
|
x86_64 |
4.18.0-147.5.1.0.h269.eulerosv2r9.x86_64 |
|
|
KYLIN10 |
AArch64 |
4.19.90-17.ky10.aarch64 |
|
x86_64 |
4.19.90-17.ky10.x86_64 |
|
|
KYLIN10SP2 |
AArch64 |
4.19.90-24.4.v2101.ky10.aarch64 |
|
x86_64 |
4.19.90-24.4.v2101.ky10.x86_64 |
|
|
OPENEULER20.03 |
AArch64 |
4.19.90-2003.4.0.0036.oe1.aarch64 |
|
x86_64 |
4.19.90-2003.4.0.0036.oe1.x86_64 |
|
|
OPENEULER20.03SP1 |
AArch64 |
4.19.90-2012.4.0.0053.oe1.aarch64 |
|
x86_64 |
4.19.90-2012.5.0.0054.oe1.x86_64 |
|
|
Oracle Linux7.9 |
x86_64 |
5.4.17-2011.6.2.el7uek.x86_64 |
|
Oracle Linux8.2 |
x86_64 |
5.4.17-2011.1.2.el8uek.x86_64 |
|
Oracle Linux8.3 |
x86_64 |
5.4.17-2011.7.4.el8uek.x86_64 |
|
Oracle Linux8.4 |
x86_64 |
5.4.17-2102.201.3.el8uek.x86_64 |
|
RHEL/CentOS7.2 |
x86_64 |
3.10.0-327.el7.x86_64 |
|
RHEL/CentOS7.4 |
ppc64 |
3.10.0-693.el7.ppc64 |
|
ppc64le |
3.10.0-693.el7.ppc64le |
|
|
x86_64 |
3.10.0-693.el7.x86_64 |
|
|
RHEL/CentOS7.6 |
ppc64 |
3.10.0-957.el7.ppc64 |
|
ppc64le |
3.10.0-957.el7.ppc64le |
|
|
x86_64 |
3.10.0-957.el7.x86_64 |
|
|
RHEL/CentOS7.9 |
ppc64 |
3.10.0-1160.el7.ppc64 |
|
ppc64le |
3.10.0-1160.el7.ppc64le |
|
|
x86_64 |
3.10.0-1160.el7.x86_64 |
|
|
RHEL/CentOS8.0 |
AArch64 |
4.18.0-80.el8.aarch64 |
|
ppc64le |
4.18.0-80.el8.ppc64le |
|
|
x86_64 |
4.18.0-80.el8.x86_64 |
|
|
RHEL/CentOS8.1 |
AArch64 |
4.18.0-147.el8.aarch64 |
|
ppc64le |
4.18.0-147.el8.ppc64le |
|
|
x86_64 |
4.18.0-147.el8.x86_64 |
|
|
RHEL/CentOS8.2 |
AArch64 |
4.18.0-193.el8.aarch64 |
|
ppc64le |
4.18.0-193.el8.ppc64le |
|
|
x86_64 |
4.18.0-193.el8.x86_64 |
|
|
RHEL/CentOS8.3 |
AArch64 |
4.18.0-240.el8.aarch64 |
|
ppc64le |
4.18.0-240.el8.ppc64le |
|
|
x86_64 |
4.18.0-240.el8.x86_64 |
|
|
RHEL/CentOS8.4 |
AArch64 |
4.18.0-305.el8.aarch64 |
|
ppc64le |
4.18.0-305.el8.ppc64le |
|
|
x86_64 |
4.18.0-305.el8.x86_64 |
|
|
RHEL/CentOS8.5 |
AArch64 |
4.18.0-348.el8.aarch64 |
|
ppc64le |
4.18.0-348.el8.ppc64le |
|
|
x86_64 |
4.18.0-348.el8.x86_64 |
|
|
SLES12SP5 |
AArch64 |
4.12.14-120-default |
|
ppc64le |
4.12.14-120-default |
|
|
x86_64 |
4.12.14-120-default |
|
|
SLES15SP2 |
AArch64 |
5.3.18-22-default |
|
ppc64le |
5.3.18-22-default |
|
|
x86_64 |
5.3.18-22-default |
|
|
SLES15SP3 |
AArch64 |
5.3.18-57-default |
|
ppc64le |
5.3.18-57-default |
|
|
x86_64 |
5.3.18-57-default |
|
|
Ubuntu18.04 |
AArch64 |
4.15.0-20-generic |
|
ppc64le |
4.15.0-20-generic |
|
|
x86_64 |
4.15.0-20-generic |
|
|
Ubuntu20.04 |
AArch64 |
5.4.0-26-generic |
|
ppc64le |
5.4.0-26-generic |
|
|
x86_64 |
5.4.0-26-generic |
|
|
Ubuntu21.10 |
x86_64 |
5.13.0-19-generic |
|
Ubuntu22.04 |
x86_64 |
5.15.0-23-generic |
|
UOS20 |
AArch64 |
4.19.0-arm64-server |
|
x86_64 |
4.19.0-server-amd64 |
|
|
UOS20.1020 |
AArch64 |
4.19.90-2109.1.0.0108.up2.uel20.aarch64 |
|
x86_64 |
4.19.90-2109.1.0.0108.up2.uel20.x86_64 |
|
|
Citrix XenServer Host7.1 |
x86_64 |
4.4.0+2 |
|
Citrix XenServer Host8.2 |
x86_64 |
4.19.0+1 |
|
Kernel 5.17 |
AArch64 |
5.17 |
|
ppc64le |
5.17 |
|
|
x86_64 |
5.17 |
|
Community OS |
Architecture |
Tested with Kernel Version |
|
BCLINUX7.6 |
x86_64 |
3.10.0-957.el7.x86_64 |
|
BCLINUX7.7 |
AArch64 |
4.19.25-203.el7.bclinux.aarch64 |
|
x86_64 |
3.10.0-1062.el7.bclinux.x86_64 |
|
|
BCLINUX8.1 |
x86_64 |
4.19.0-193.1.3.el8.bclinux.x86_64 |
|
Debian9.13 |
AArch64 |
4.9.0-13-arm64 |
|
x86_64 |
4.9.0-13-amd64 |
|
|
EulerOS2.0sp5 |
x86_64 |
3.10.0-862.14.1.5.h591.eulerosv2r7.x86_64 |
|
EulerOS2.0sp8 |
AArch64 |
4.19.36-vhulk1907.1.0.h748.eulerosv2r8.aarch64 |
|
Oracle Linux7.8 |
x86_64 |
4.14.35-1902.300.11.el7uek.x86_64 |
|
RHEL/CentOS7.5 |
ppc64 |
3.10.0-862.el7.ppc64 |
|
ppc64le |
3.10.0-862.el7.ppc64le |
|
|
x86_64 |
3.10.0-862.el7.x86_64 |
|
|
RHEL/CentOS7.5alternate |
AArch64 |
4.14.0-49.el7a.aarch64 |
|
RHEL/CentOS7.6alternate |
aarch64 |
4.14.0-115.el7a.aarch64 |
|
ppc64le |
4.14.0-115.el7a.ppc64le |
|
|
RHEL/CentOS7.7 |
ppc64 |
3.10.0-1062.el7.ppc64 |
|
ppc64le |
3.10.0-1062.el7.ppc64le |
|
|
x86_64 |
3.10.0-1062.el7.x86_64 |
|
|
RHEL/CentOS7.8 |
ppc64 |
3.10.0-1127.el7.ppc64 |
|
ppc64le |
3.10.0-1127.el7.ppc64le |
|
|
x86_64 |
3.10.0-1127.el7.x86_64 |
|
|
SLES12SP2 |
x86_64 |
4.4.21-69-default |
|
SLES12SP3 |
ppc64le |
4.4.73-5-default |
|
x86_64 |
4.4.73-5-default |
|
|
SLES12SP4 |
AArch64 |
4.12.14-94.41-default |
|
ppc64le |
4.12.14-94.41-default |
|
|
x86_64 |
4.12.14-94.41-default |
|
|
Ubuntu16.04 |
ppc64le |
4.4.0-21-generic |
|
x86_64 |
4.4.0-21-generic |
|
|
Alma 8.5 |
x86_64 |
4.18.0-348.12.2.EL8_5.X86_64 |
|
Anolis OS 8.4 |
AArch64 |
4.18.0-348.2.1.AN8_4.AARCH64 |
|
x86_64 |
4.18.0-305.AN8.X86_64 |
|
|
CentOS Stream |
AArch64 |
- |
|
ppc64le |
- |
|
|
x86_64 |
4.18.0-365.EL8.X86_64 |
|
|
Fedora 35 |
x86_64 |
5.16.8-200.fc35.x86_64 |
|
OpenEuler 20.03 SP3 |
AArch64 |
4.19.90-2112.8.0.0131.OE1.AARCH64 |
|
x86_64 |
4.19.90-2112.8.0.0131.OE1.X86_64 |
|
|
OpenSUSE 15.3 |
AArch64 |
- |
|
ppc64le |
- |
|
|
x86_64 |
5.3.18-150300.59.43-DEFAULT |
|
|
Photon OS 3.0 |
x86_64 |
4.19.225-3.ph3 |
|
Rocky 8.5 |
AArch64 |
- |
|
x86_64 |
4.18.0-348.12.2.EL8_5.X86_64 |
32 bit platforms are no longer supported in MLNX_OFED
For RPM-based distributions, to install OFED on a different kernel, create a new ISO image using mlnx_add_kernel_support.sh script (see the MLNX_OFED User Manual for instructions)
Upgrading MLNX_OFED on a cluster requires upgrading all of its nodes to the newest version as well
If using MLNX_OFED 4.9 LTS with MLNX_OFED 5.x with upstream verbs, MLNX_OFED 4.9 must be installed with --upstream-libs flag so the verbs libraries match.
A combination of 4.9 LTS default verbs and MOFED 5.x upstream verbs is not supported.
All operating systems listed above are fully supported in Paravirtualized and SR-IOV environments with Linux KVM Hypervisor
The following are the supported non-Linux Virtual Machines in this current version:
|
NIC |
Windows Virtual Machine Type |
Minimal WinOF Version |
Protocol |
|
ConnectX-4 |
Windows 2012 R2 DC |
MLNX_WinOF2 2.50 |
IB, IPoIB, ETH |
|
ConnectX-4 Lx |
Windows 2016 DC |
MLNX_WinOF2 2.50 |
IB, IPoIB, ETH |
|
ConnectX-5 family |
All Windows server editions |
MLNX_WinOF2 2.50 |
IPoIB, ETH |
|
ConnectX-6 family |
MLNX_WinOF2 2.50 |
IPoIB, ETH |
ASAP2 Supported Operating Systems
OVS-Kernel SR-IOV Based Supported Operating Systems
Below is a list of all the operating systems that support OVS-Kernel ASAP2 in the current software package.
BCLinux 7.7
BCLinux 8.1
RHEL/CentOS 7.4
RHEL/CentOS 7.5
RHEL/CentOS 7.6
RHEL/CentOS 7.7
RHEL/CentOS 7.8
RHEL/CentOS 8.0
RHEL/CentOS 8.1
RHEL/CentOS 8.2
RHEL/CentOS 8.3
RHEL /Centos 8.4
RHEL /Centos 8.5
Oracle Linux 7.8
Oracle Linux 8.1
Oracle Linux 8.2
Oracle Linux 8.3
Oracle Linux 8.4
SLES12 SP4
SLES12 SP5
SLES15 SP2
Ubuntu 16.04
Ubuntu 18.04
Ubuntu 20.04
Ubuntu 21.10
Up to kernel 5.17
OVS-DPDK SR-IOV Based Supported OSs
Below is a list of all the operating systems that support OVS-DPDK ASAP2 in the current software package.
RHEL/CentOS 7.4
RHEL/CentOS 7.5
RHEL/CentOS 7.6
RHEL/CentOS 7.7
RHEL/CentOS 7.8
RHEL/CentOS 8.0
RHEL/CentOS 8.1
RHEL/CentOS 8.2
RHEL/CentOS 8.3
RHEL/CentOS 8.4
RHEL/CentOS 8.5
Ubuntu 18.04
Ubuntu 20.04
Ubuntu 21.10
SLES15 SP2
ASAP2 Requirements
iproute >= 4.12 (for tc support)
Upstream Open vSwitch >= 2.8 for CentOS 7.2 NVIDIA openvswitch
ASAP2 Supported Adapter Cards
ConnectX-5
ConnectX-6 Dx
|
UCX Version |
Built with CUDA version |
Compatible with CUDA versions |
|
1.13 |
11.6 |
11.x |
NFSoRDMA Supported Operating Systems on Client and Target Sides
SLES12 SP4
SLES12 SP5
SLES15 SP2
SLES15 SP3
Ubuntu 18.04
Ubuntu 20.04
Ubuntu 21.10
Ubuntu 22.04
RHEL 7.5
RHEL 7.6
RHEL 7.7
RHEL 7.8
RHEL 7.9
RHEL 8.1
RHEL 8.2
RHEL 8.4
RHEL 8.5
Kernel 5.17
Lustre 2.12.8
Lustre 2.14.0 with patches for the following:
RedHat 7.4
RedHat 7.5
RedHat 7.6
RedHat 7.7
RedHat 7.8
RedHat 7.9
RedHat 8.x
Oracle Linux 7.8
Oracle Linux 7.9
Oracle Linux 8.1
Oracle Linux 8.2
Oracle Linux 8.3
Fedora 32
SLES 12 SP3
SLES 12 SP4
SLES 12 SP5
SLES 15 SP1
SLES 15 SP2
SLES 15 SP3
Ubuntu 18.04
Ubuntu 20.04
Ubuntu 21
Debian 10
Debian 10.3
Rhel 8.x
Ubuntu 18.04
Ubuntu 20.04
Linux operating system
Administrator privileges on your machine(s)
Disk Space: 1GB
For the OFED Distribution to compile on your machine, some software packages of your operating
system (OS) distribution are required.
To install the additional packages, run the following commands per OS:
|
Operating System |
Required Packages Installation Command |
|
RHEL/Oracle Linux/Fedora |
yum install perl pciutils python gcc-gfortran libxml2-python tcsh libnl.i686 libnl expat glib2 tcl libstdc++ bc tk gtk2 atk cairo numactl pkgconfig ethtool lsof |
|
XenServer |
yum install perl pciutils python libxml2-python libnl expat glib2 tcl bc libstdc++ tk pkgconfig ethtool |
|
SLES 12 |
zypper install pkg-config expat libstdc++6 libglib-2_0-0 lib- gtk-2_0-0 tcl libcairo2 tcsh python bc pciutils libatk-1_0-0 tk python-libxml2 lsof libnl3-200 ethtool lsof |
|
SLES 15 |
python ethtool libatk-1_0-0 python2-libxml2-python tcsh lib- stdc++6-devel-gcc7 libgtk-2_0-0 tcl libopenssl1_1 libnl3-200 make libcairo2 expat libmnl0 insserv-compat pciutils lsof lib- glib-2_0-0 pkg-config tk |
|
Ubuntu/Debian |
apt-get install perl dpkg autotools-dev autoconf libtool auto- make1.10 automake m4 dkms debhelper tcl tcl8.4 chrpath swig graphviz tcl-dev tcl8.4-dev tk-dev tk8.4-dev bison flex dpatch zlib1g-dev curl libcurl4-gnutls-dev python-libxml2 libvirt-bin libvirt0 libnl-dev libglib2.0-dev libgfortran3 automake m4 pkg-config libnuma logrotate ethtool lsof |
As of version 5.1, ConnectX-3, ConnectX-3 Pro or Connect-IB NICs are no longer supported. To work with a version that supports these adapter cards, please refer to version 4.9 long-term support (LTS).
This current version is tested with the following NVIDIA NIC firmware versions:
Firmware versions listed are the minimum supported versions.
|
Adapter Card |
Recommended Firmware Version |
Additional Firmware Version Supported |
|
BlueField®-2 |
24.33.1048 |
24.32.1010 |
|
BlueField |
18.33.1048 |
18.32.1010 |
|
ConnectX-7 |
28.33.2028 |
N/A |
|
ConnectX-6 Lx |
26.33.1048 |
26.32.1010 |
|
ConnectX-6 Dx |
22.33.1048 |
22.32.2004 |
|
ConnectX-6 |
20.33.1048 |
20.32.1010 |
|
ConnectX-5/ConnectX-5 Ex |
16.33.1048 |
16.32.1010 |
|
ConnectX-4 Lx |
14.32.1010 |
14.32.1010 |
|
ConnectX-4 |
12.28.2006 |
12.28.2006 |
For the official firmware versions, please see https://www.nvidia.com/en-us/networking/ → Support → Support → Firmware Download.
The following are the unsupported functionalities/features/NICs in the current version:
ConnectX-2 adapter card
ConnectX-3 adapter card
ConnectX-3 Pro adapter card
Connect-IB adapter card
Soft-RoCE
RDMA experimental verbs library (mlnx_lib)
Relational Database Service (RDS)
mthca InfiniBand driver
Ethernet IPoIB (eIPoIB)