Supported Operating Systems
Operating System | Architecture | Default Kernel Version (Primary)/ | OS Support Model | ASAP2 OVS-Kernel SR-IOV | ASAP2 OVS-DPDK SR-IOV | NFSoRDMA | NVMe | GPUDirect Storage (GDS) | UCX-CUDA Version | NEO-Host |
---|---|---|---|---|---|---|---|---|---|---|
ALIOS7.2 | AArch64 | 4.19.48-006.ali4000.alios7.aarch64 | Primary | |||||||
Alma 8.5 | x86_64 | 4.18.0-348.12.2.EL8_5.X86_64 | Community | |||||||
Anolis OS 8.4 | AArch64 | 4.18.0-348.2.1.AN8_4.AARCH64 | Community | |||||||
x86_64 | 4.18.0-305.AN8.X86_64 | Community | ||||||||
BCLINUX21.10SP2 | AArch64 | 4.19.90-2107.6.0.0098.oe1.bclinux.aarch64 | Primary | |||||||
BCLINUX8.1 | AArch64 | Community | ||||||||
x86_64 | 4.19.0-193.1.3.el8.bclinux.x86_64 | Community | ||||||||
BCLINUX8.2 | x86_64 | 4.19.0-240.23.11.el8_2.bclinux.x86_64 | Primary | |||||||
CentOS Stream v8 | AArch64 | 4.18.0-448.el8 | Community | |||||||
x86_64 | 4.18.0-448.el8.x86_64 | Community | ||||||||
CentOS Stream v9 | AArch64 | 5.14.0-267.el9 | Community | |||||||
x86_64 | 5.14.0-267.el9.x86_64 | Community | ||||||||
CTYUNOS2.0 | AArch64 | 4.19.90-2102.2.0.0062.ctl2.aarch64 | Primary | |||||||
x86_64 | 4.19.90-2102.2.0.0062.ctl2.x86_64 | Primary | ||||||||
Debian10.8 | AArch64 | 4.19.0-14-arm64 | Primary | |||||||
x86_64 | 4.19.0-14-amd64 | Primary | ||||||||
Debian10.9 | x86_64 | 4.19.0-16-amd64 | Primary | |||||||
Debian11.3 | AArch64 | 5.10.0-13-arm64 | Primary | |||||||
x86_64 | 5.10.0-13-amd64 | Primary | ||||||||
Debian9.13 | AArch64 | 4.9.0-13-arm64 | Primary | |||||||
x86_64 | 4.9.0-13-amd64 | Primary | ||||||||
EulerOS2.0sp8 | AArch64 | 4.19.36-vhulk1907.1.0.h748.eulerosv2r8.aarch64 | Community | |||||||
EulerOS2.0sp10 | AArch64 | 4.19.90-vhulk2110.1.0.h860.eulerosv2r10.aarch64 | Primary | |||||||
x86_64 | 4.18.0-147.5.2.4.h694.eulerosv2r10.x86_64 | Primary | ||||||||
EulerOS2.0sp11 | AArch64 | 5.10.0-60.18.0.50.h323.eulerosv2r11.aarch64 | Primary | |||||||
x86_64 | 5.10.0-60.18.0.50.h323.eulerosv2r11.x86_64 | Primary | ||||||||
EulerOS2.0sp9 | AArch64 | 4.19.90-vhulk2006.2.0.h171.eulerosv2r9.aarch64 | Primary | |||||||
x86_64 | 4.18.0-147.5.1.0.h269.eulerosv2r9.x86_64 | Primary | ||||||||
Fedora 35 | x86_64 | 5.16.8-200.fc35.x86_64 | Community | |||||||
KYLIN10 | AArch64 | 4.19.90-17.ky10.aarch64 | Primary | |||||||
x86_64 | 4.19.90-17.ky10.x86_64 | Primary | ||||||||
KYLIN10SP2 | AArch64 | 4.19.90-24.4.v2101.ky10.aarch64 | Primary | |||||||
x86_64 | 4.19.90-24.4.v2101.ky10.x86_64 | Primary | ||||||||
Oracle Linux 7.9 | x86_64 | 5.4.17-2011.6.2.el7uek.x86_64 | Primary | |||||||
Oracle Linux 8.4 | x86_64 | 5.4.17-2102.201.3.el8uek.x86_64 | Primary | |||||||
Oracle Linux 8.6 | x86_64 | 5.4.17-2136.307.3.1.el8uek.x86_64 | Primary | |||||||
Oracle Linux 9.0 | x86_64 | 5.15.0-0.30.19.el9uek.x86_64 | Primary | |||||||
OpenSUSE 15.3 | AArch64 | - | Community | |||||||
ppc64le | - | Community | ||||||||
x86_64 | 5.3.18-150300.59.43-DEFAULT | Community | ||||||||
OPENEULER20.03SP3 | AArch64 | 4.19.90-2112.8.0.0131.oe1.aarch64 | Primary | |||||||
x86_64 | 4.19.90-2112.8.0.0131.oe1.x86_64 | Primary | ||||||||
OPENEULER22.03 | AArch64 | 5.10.0-60.18.0.50.oe2203.aarch64 | Primary | |||||||
x86_64 | 5.10.0-60.18.0.50.oe2203.x86_64 | Primary | ||||||||
Photon OS 3.0 | x86_64 | 4.19.225-3.ph3 | Community | |||||||
RHEL/CentOS7.2 | x86_64 | 3.10.0-327.el7.x86_64 | Primary | 11.7 | ||||||
RHEL/CentOS7.4 | ppc64 | 3.10.0-693.el7.ppc64 | Primary | |||||||
ppc64le | 3.10.0-693.el7.ppc64le | Primary | ||||||||
x86_64 | 3.10.0-693.el7.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS7.6 | ppc64 | 3.10.0-957.el7.ppc64 | Primary | |||||||
ppc64le | 3.10.0-957.el7.ppc64le | Primary | ||||||||
x86_64 | 3.10.0-957.el7.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS7.6alternate | aarch64 | 4.14.0-115.el7a.aarch64 | Community | |||||||
ppc64le | 4.14.0-115.el7a.ppc64le | Community | ||||||||
RHEL/CentOS7.7 | x86_64 | 3.10.0-1062.el7.x86_64 | Primary | 11.7 | ||||||
RHEL/CentOS7.8 | ppc64 | 3.10.0-1127.el7.ppc64 | Primary | |||||||
ppc64le | 3.10.0-1127.el7.ppc64le | Primary | ||||||||
x86_64 | 3.10.0-1127.el7.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS7.9 | ppc64 | 3.10.0-1160.el7.ppc64 | Primary | |||||||
ppc64le | 3.10.0-1160.el7.ppc64le | Primary | ||||||||
x86_64 | 3.10.0-1160.el7.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS8.0 | AArch64 | 4.18.0-80.el8.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-80.el8.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-80.el8.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS8.1 | AArch64 | 4.18.0-147.el8.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-147.el8.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-147.el8.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS8.2 | AArch64 | 4.18.0-193.el8.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-193.el8.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-193.el8.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS8.3 | AArch64 | 4.18.0-240.el8.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-240.el8.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-240.el8.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS8.4 | AArch64 | 4.18.0-305.el8.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-305.el8.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-305.el8.x86_64 | Primary | 11.7 | |||||||
RHEL/CentOS/Rocky8.5 | AArch64 | 4.18.0-348.el8.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-348.el8.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-348.el8.x86_64 | Primary | 11.7 | |||||||
RHEL/Rocky8.6 | AArch64 | 4.18.0-372.41.1.el8_6.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-372.41.1.el8_6.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-372.41.1.el8_6.x86_64 | Primary | 11.7 | |||||||
RHEL/Rocky8.7 | AArch64 | 4.18.0-425.14.1.el8_7.aarch64 | Primary | 11.7 | ||||||
ppc64le | 4.18.0-425.14.1.el8_7.ppc64le | Primary | ||||||||
x86_64 | 4.18.0-425.14.1.el8_7.x86_64 | Primary | 11.7 | |||||||
RHEL/Rocky9.0 | AArch64 | 5.14.0-70.46.1.el9_0.aarch64 | Primary | 11.7 | ||||||
ppc64le | 5.14.0-70.46.1.el9_0.ppc64le | Primary | ||||||||
x86_64 | 5.14.0-70.46.1.el9_0.x86_64 | Primary | 11.7 | |||||||
RHEL/Rocky9.1 | AArch64 | 5.14.0-162.19.1.el9_1.aarch64 | Primary | 11.7 | ||||||
ppc64le | 5.14.0-162.19.1.el9_1.ppc64le | Primary | ||||||||
x86_64 | 5.14.0-162.19.1.el9_1.x86_64 | Primary | 11.7 | |||||||
SLES12SP2 | x86_64 | 4.4.21-69-default | Community | |||||||
SLES12SP3 | ppc64le | 4.4.73-5-default | Community | |||||||
x86_64 | 4.4.73-5-default | Community | ||||||||
SLES12SP4 | AArch64 | 4.12.14-94.41-default | Community | |||||||
ppc64le | 4.12.14-94.41-default | Community | ||||||||
x86_64 | 4.12.14-94.41-default | Community | ||||||||
SLES12SP5 | AArch64 | 4.12.14-120-default | Primary | |||||||
ppc64le | 4.12.14-120-default | Primary | ||||||||
x86_64 | 4.12.14-120-default | Primary | ||||||||
SLES15SP2 | AArch64 | 5.3.18-22-default | Primary | |||||||
ppc64le | 5.3.18-22-default | Primary | ||||||||
x86_64 | 5.3.18-22-default | Primary | ||||||||
SLES15SP3 | AArch64 | 5.3.18-57-default | Primary | |||||||
ppc64le | 5.3.18-57-default | Primary | ||||||||
x86_64 | 5.3.18-57-default | Primary | ||||||||
SLES15SP4 | AArch64 | 5.14.21-150400.22-default | Primary | |||||||
ppc64le | 5.14.21-150400.22-default | Primary | ||||||||
x86_64 | 5.14.21-150400.22-default | Primary | ||||||||
Ubuntu16.04 | ppc64le | 4.4.0-21-generic | Community | |||||||
x86_64 | 4.4.0-21-generic | Community | ||||||||
Ubuntu18.04 | AArch64 | 4.15.0-20-generic | Primary | 11.6 | ||||||
ppc64le | 4.15.0-20-generic | Primary | ||||||||
x86_64 | 4.15.0-20-generic | Primary | 11.6 | |||||||
Ubuntu20.04 | AArch64 | 5.4.0-26-generic | Primary | 11.7 | ||||||
ppc64le | 5.4.0-26-generic | Primary | ||||||||
x86_64 | 5.4.0-26-generic | Primary | 11.7 | |||||||
Ubuntu22.04 | AArch64 | 5.15.0-25-generic | Primary | 11.7 | ||||||
ppc64le | 5.15.0-25-generic | Primary | ||||||||
x86_64 | 5.15.0-25-generic | Primary | 11.7 | |||||||
Ubuntu22.10 | x86_64 | 5.19.0-15-generic | Primary | |||||||
UOS20.1020 | AArch64 | 4.19.90-2109.1.0.0108.up2.uel20.aarch64 | Primary | |||||||
x86_64 | 4.19.90-2109.1.0.0108.up2.uel20.x86_64 | Primary | ||||||||
UOS20.1040 | AArch64 | 4.19.0-arm64-server | Primary | |||||||
x86_64 | 4.19.0-server-amd64 | Primary | ||||||||
Citrix XenServer Host7.1 | x86_64 | 4.4.0+2 | Primary | |||||||
Citrix XenServer Host8.2 | x86_64 | 4.19.0+1 | Primary | |||||||
Kernel 6.0 | AArch64 | 6.0 | Primary | |||||||
ppc64le | 6.0 | Primary | ||||||||
x86_64 | 6.0 | Primary |
- 32 bit platforms are no longer supported in MLNX_OFED
- For RPM-based distributions, to install OFED on a different kernel, create a new ISO image using mlnx_add_kernel_support.sh script (see the MLNX_OFED User Manual for instructions)
- Upgrading MLNX_OFED on a cluster requires upgrading all of its nodes to the newest version as well
- If using MLNX_OFED 4.9 LTS with MLNX_OFED 5.x with upstream verbs, MLNX_OFED 4.9 must be installed with
--upstream-libs
flag so the verbs libraries match. - A combination of 4.9 LTS default verbs and MOFED 5.x upstream verbs is not supported.
- All operating systems listed above are fully supported in Paravirtualized and SR-IOV environments with Linux KVM Hypervisor
Upgrade/Downgrade Matrix
This section reflects which versions were tested and verified for upgrade and downgrade.
Target Version | Versions Verified for Upgrade/Downgrade | Release Type | Release Date |
---|---|---|---|
5.8-2.0.3.0 GA-LTS-Update (February 2023 Update #2) | 5.8-1.1.2.1 | GA-LTS-Update #1 | Novemer 2022 |
5.8-1.0.1.1 | GA-LTS | October 2022 | |
5.7-1.0.2.0 | GA | July 2022 | |
5.4-3.6.8.1 | GA-LTS-Update | Novemer 2022 |
MLNX_OFED Version Interoperability
This section reflects which versions were tested and verified for multi-version environments.
Target Version | Verified OFED Version Interoperability | Release Type | Release Date |
---|---|---|---|
5.8-2.0.3.0 GA-LTS-Update (February 2023 Update #2) | 5.8-1.1.2.1 | GA-LTS-Update #1 | November 2022 |
Supported Non-Linux Virtual Machines
The following are the supported non-Linux Virtual Machines in this current version:
NIC | Windows Virtual Machine Type | Minimal WinOF Version | Protocol |
---|---|---|---|
ConnectX-4 | Windows 2012 R2 DC | MLNX_WinOF2 2.50 | IB, IPoIB, ETH |
ConnectX-4 Lx | Windows 2016 DC | MLNX_WinOF2 2.50 | IB, IPoIB, ETH |
ConnectX-5 family | All Windows server editions | MLNX_WinOF2 2.50 | IPoIB, ETH |
ConnectX-6 family | MLNX_WinOF2 2.50 | IPoIB, ETH |
Support in ASAP2—Accelerated Switch and Packet Processing®
ASAP2 Requirements |
|
---|---|
ASAP2 -Supported Adapter Cards |
|
Lustre Versions Compatible with MLNX_OFED
- Lustre 2.15.1
- Lustre 2.12.9
Hardware and Software Requirements
- Linux operating system
- Administrator privileges on your machine(s)
- Disk Space: 1GB
For the OFED Distribution to compile on your machine, some software packages of your operating system (OS) distribution are required.
To install the additional packages, run the following commands per OS:
Operating System | Required Packages Installation Command |
---|---|
RHEL/Oracle Linux/Fedora |
|
XenServer |
|
SLES 12 |
|
SLES 15 |
|
Ubuntu/Debian |
|
Supported NIC Firmware Versions
As of version 5.1, ConnectX-3, ConnectX-3 Pro or Connect-IB adapter cards are no longer supported. To work with a version that supports these adapter cards, please refer to version 4.9 long-term support (LTS).
This current version is tested with the following NVIDIA adapter card firmware versions:
Adapter Card | Bundled Firmware Version | Additional Supported Firmware Version |
---|---|---|
BlueField®-2 | 24.35.2000 | 24.35.1012 |
BlueField | 18.33.1048 | N/A |
ConnectX-7 | 28.35.2000 | 28.35.1012 |
ConnectX-6 Lx | 26.35.2000 | 26.35.1012 |
ConnectX-6 Dx | 22.35.2000 | 22.35.2302 (It is recommended to upgrade to this firmware version becasue it improves physical-layer performace. For further information, see the firmware release notes.) |
ConnectX-6 | 20.35.2000 | 20.35.1012 |
ConnectX-5/ConnectX-5 Ex | 16.35.2000 | 16.35.1012 |
ConnectX-4 Lx | 14.32.1010 | N/A |
ConnectX-4 | 12.28.2006 | N/A |
For the official firmware versions, please see https://www.nvidia.com/en-us/networking/ → Support → Support → Firmware Download.
Unsupported Functionalities/Features/NICs
The following are the unsupported functionalities/features/NICs in the current version:
- ConnectX-2 adapter card
- ConnectX-3 adapter card
- ConnectX-3 Pro adapter card
- Connect-IB adapter card
- Soft-RoCE
- RDMA experimental verbs library (mlnx_lib)
- Relational Database Service (RDS)
- mthca InfiniBand driver
- Ethernet IPoIB (eIPoIB)