NVIDIA MLNX_OFED Documentation v5.6-1.0.3.3
Linux Kernel Upstream Release Notes v5.17

General Support

Operating System

Architecture

Default Kernel Version

ALIOS7.2

AArch64

4.19.48-006.ali4000.alios7.aarch64

BCLINUX21.10SP2

AArch64

4.19.90-2107.6.0.0098.oe1.bclinux.aarch64

BCLINUX8.2

x86_64

4.19.0-240.23.11.el8_2.bclinux.x86_64

Debian10.8

AArch64

4.19.0-14-arm64

x86_64

4.19.0-14-amd64

Debian10.9

x86_64

4.19.0-16-amd64

Debian11.2

AArch64

5.10.0-10-arm64

x86_64

5.10.0-10-amd64

EulerOS2.0sp10

AArch64

4.19.90-vhulk2110.1.0.h860.eulerosv2r10.aarch64

x86_64

4.18.0-147.5.2.4.h694.eulerosv2r10.x86_64

EulerOS2.0sp9

AArch64

4.19.90-vhulk2006.2.0.h171.eulerosv2r9.aarch64

x86_64

4.18.0-147.5.1.0.h269.eulerosv2r9.x86_64

KYLIN10

AArch64

4.19.90-17.ky10.aarch64

x86_64

4.19.90-17.ky10.x86_64

KYLIN10SP2

AArch64

4.19.90-24.4.v2101.ky10.aarch64

x86_64

4.19.90-24.4.v2101.ky10.x86_64

OPENEULER20.03

AArch64

4.19.90-2003.4.0.0036.oe1.aarch64

x86_64

4.19.90-2003.4.0.0036.oe1.x86_64

OPENEULER20.03SP1

AArch64

4.19.90-2012.4.0.0053.oe1.aarch64

x86_64

4.19.90-2012.5.0.0054.oe1.x86_64

Oracle Linux7.9

x86_64

5.4.17-2011.6.2.el7uek.x86_64

Oracle Linux8.2

x86_64

5.4.17-2011.1.2.el8uek.x86_64

Oracle Linux8.3

x86_64

5.4.17-2011.7.4.el8uek.x86_64

Oracle Linux8.4

x86_64

5.4.17-2102.201.3.el8uek.x86_64

RHEL/CentOS7.2

x86_64

3.10.0-327.el7.x86_64

RHEL/CentOS7.4

ppc64

3.10.0-693.el7.ppc64

ppc64le

3.10.0-693.el7.ppc64le

x86_64

3.10.0-693.el7.x86_64

RHEL/CentOS7.6

ppc64

3.10.0-957.el7.ppc64

ppc64le

3.10.0-957.el7.ppc64le

x86_64

3.10.0-957.el7.x86_64

RHEL/CentOS7.9

ppc64

3.10.0-1160.el7.ppc64

ppc64le

3.10.0-1160.el7.ppc64le

x86_64

3.10.0-1160.el7.x86_64

RHEL/CentOS8.0

AArch64

4.18.0-80.el8.aarch64

ppc64le

4.18.0-80.el8.ppc64le

x86_64

4.18.0-80.el8.x86_64

RHEL/CentOS8.1

AArch64

4.18.0-147.el8.aarch64

ppc64le

4.18.0-147.el8.ppc64le

x86_64

4.18.0-147.el8.x86_64

RHEL/CentOS8.2

AArch64

4.18.0-193.el8.aarch64

ppc64le

4.18.0-193.el8.ppc64le

x86_64

4.18.0-193.el8.x86_64

RHEL/CentOS8.3

AArch64

4.18.0-240.el8.aarch64

ppc64le

4.18.0-240.el8.ppc64le

x86_64

4.18.0-240.el8.x86_64

RHEL/CentOS8.4

AArch64

4.18.0-305.el8.aarch64

ppc64le

4.18.0-305.el8.ppc64le

x86_64

4.18.0-305.el8.x86_64

RHEL/CentOS8.5

AArch64

4.18.0-348.el8.aarch64

ppc64le

4.18.0-348.el8.ppc64le

x86_64

4.18.0-348.el8.x86_64

SLES12SP5

AArch64

4.12.14-120-default

ppc64le

4.12.14-120-default

x86_64

4.12.14-120-default

SLES15SP2

AArch64

5.3.18-22-default

ppc64le

5.3.18-22-default

x86_64

5.3.18-22-default

SLES15SP3

AArch64

5.3.18-57-default

ppc64le

5.3.18-57-default

x86_64

5.3.18-57-default

Ubuntu18.04

AArch64

4.15.0-20-generic

ppc64le

4.15.0-20-generic

x86_64

4.15.0-20-generic

Ubuntu20.04

AArch64

5.4.0-26-generic

ppc64le

5.4.0-26-generic

x86_64

5.4.0-26-generic

Ubuntu21.10

x86_64

5.13.0-19-generic

Ubuntu22.04

x86_64

5.15.0-23-generic

UOS20

AArch64

4.19.0-arm64-server

x86_64

4.19.0-server-amd64

UOS20.1020

AArch64

4.19.90-2109.1.0.0108.up2.uel20.aarch64

x86_64

4.19.90-2109.1.0.0108.up2.uel20.x86_64

Citrix XenServer Host7.1

x86_64

4.4.0+2

Citrix XenServer Host8.2

x86_64

4.19.0+1

Kernel 5.17

AArch64

5.17

ppc64le

5.17

x86_64

5.17

Community OS

Architecture

Tested with Kernel Version

BCLINUX7.6

x86_64

3.10.0-957.el7.x86_64

BCLINUX7.7

AArch64

4.19.25-203.el7.bclinux.aarch64

x86_64

3.10.0-1062.el7.bclinux.x86_64

BCLINUX8.1

x86_64

4.19.0-193.1.3.el8.bclinux.x86_64

Debian9.13

AArch64

4.9.0-13-arm64

x86_64

4.9.0-13-amd64

EulerOS2.0sp5

x86_64

3.10.0-862.14.1.5.h591.eulerosv2r7.x86_64

EulerOS2.0sp8

AArch64

4.19.36-vhulk1907.1.0.h748.eulerosv2r8.aarch64

Oracle Linux7.8

x86_64

4.14.35-1902.300.11.el7uek.x86_64

RHEL/CentOS7.5

ppc64

3.10.0-862.el7.ppc64

ppc64le

3.10.0-862.el7.ppc64le

x86_64

3.10.0-862.el7.x86_64

RHEL/CentOS7.5alternate

AArch64

4.14.0-49.el7a.aarch64

RHEL/CentOS7.6alternate

aarch64

4.14.0-115.el7a.aarch64

ppc64le

4.14.0-115.el7a.ppc64le

RHEL/CentOS7.7

ppc64

3.10.0-1062.el7.ppc64

ppc64le

3.10.0-1062.el7.ppc64le

x86_64

3.10.0-1062.el7.x86_64

RHEL/CentOS7.8

ppc64

3.10.0-1127.el7.ppc64

ppc64le

3.10.0-1127.el7.ppc64le

x86_64

3.10.0-1127.el7.x86_64

SLES12SP2

x86_64

4.4.21-69-default

SLES12SP3

ppc64le

4.4.73-5-default

x86_64

4.4.73-5-default

SLES12SP4

AArch64

4.12.14-94.41-default

ppc64le

4.12.14-94.41-default

x86_64

4.12.14-94.41-default

Ubuntu16.04

ppc64le

4.4.0-21-generic

x86_64

4.4.0-21-generic

Alma 8.5

x86_64

4.18.0-348.12.2.EL8_5.X86_64

Anolis OS 8.4

AArch64

4.18.0-348.2.1.AN8_4.AARCH64

x86_64

4.18.0-305.AN8.X86_64

CentOS Stream

AArch64

-

ppc64le

-

x86_64

4.18.0-365.EL8.X86_64

Fedora 35

x86_64

5.16.8-200.fc35.x86_64

OpenEuler 20.03 SP3

AArch64

4.19.90-2112.8.0.0131.OE1.AARCH64

x86_64

4.19.90-2112.8.0.0131.OE1.X86_64

OpenSUSE 15.3

AArch64

-

ppc64le

-

x86_64

5.3.18-150300.59.43-DEFAULT

Photon OS 3.0

x86_64

4.19.225-3.ph3

Rocky 8.5

AArch64

-

x86_64

4.18.0-348.12.2.EL8_5.X86_64

Warning
  • 32 bit platforms are no longer supported in MLNX_OFED

  • For RPM-based distributions, to install OFED on a different kernel, create a new ISO image using mlnx_add_kernel_support.sh script (see the MLNX_OFED User Manual for instructions)

  • Upgrading MLNX_OFED on a cluster requires upgrading all of its nodes to the newest version as well

  • If using MLNX_OFED 4.9 LTS with MLNX_OFED 5.x with upstream verbs, MLNX_OFED 4.9 must be installed with --upstream-libs flag so the verbs libraries match.

  • A combination of 4.9 LTS default verbs and MOFED 5.x upstream verbs is not supported.

  • All operating systems listed above are fully supported in Paravirtualized and SR-IOV environments with Linux KVM Hypervisor

The following are the supported non-Linux Virtual Machines in this current version:

NIC

Windows Virtual Machine Type

Minimal WinOF Version

Protocol

ConnectX-4

Windows 2012 R2 DC

MLNX_WinOF2 2.50

IB, IPoIB, ETH

ConnectX-4 Lx

Windows 2016 DC

MLNX_WinOF2 2.50

IB, IPoIB, ETH

ConnectX-5 family

All Windows server editions

MLNX_WinOF2 2.50

IPoIB, ETH

ConnectX-6 family

MLNX_WinOF2 2.50

IPoIB, ETH

ASAP2 Supported Operating Systems

OVS-Kernel SR-IOV Based Supported Operating Systems

Below is a list of all the operating systems that support OVS-Kernel ASAP2 in the current software package.

  • BCLinux 7.7

  • BCLinux 8.1

  • RHEL/CentOS 7.4

  • RHEL/CentOS 7.5

  • RHEL/CentOS 7.6

  • RHEL/CentOS 7.7

  • RHEL/CentOS 7.8

  • RHEL/CentOS 8.0

  • RHEL/CentOS 8.1

  • RHEL/CentOS 8.2

  • RHEL/CentOS 8.3

  • RHEL /Centos 8.4

  • RHEL /Centos 8.5

  • Oracle Linux 7.8

  • Oracle Linux 8.1

  • Oracle Linux 8.2

  • Oracle Linux 8.3

  • Oracle Linux 8.4

  • SLES12 SP4

  • SLES12 SP5

  • SLES15 SP2

  • Ubuntu 16.04

  • Ubuntu 18.04

  • Ubuntu 20.04

  • Ubuntu 21.10

  • Up to kernel 5.17

OVS-DPDK SR-IOV Based Supported OSs

Below is a list of all the operating systems that support OVS-DPDK ASAP2 in the current software package.

  • RHEL/CentOS 7.4

  • RHEL/CentOS 7.5

  • RHEL/CentOS 7.6

  • RHEL/CentOS 7.7

  • RHEL/CentOS 7.8

  • RHEL/CentOS 8.0

  • RHEL/CentOS 8.1

  • RHEL/CentOS 8.2

  • RHEL/CentOS 8.3

  • RHEL/CentOS 8.4

  • RHEL/CentOS 8.5

  • Ubuntu 18.04

  • Ubuntu 20.04

  • Ubuntu 21.10

  • SLES15 SP2

ASAP2 Requirements

  • iproute >= 4.12 (for tc support)

  • Upstream Open vSwitch >= 2.8 for CentOS 7.2 NVIDIA openvswitch

ASAP2 Supported Adapter Cards

  • ConnectX-5

  • ConnectX-6 Dx

UCX Version

Built with CUDA version

Compatible with CUDA versions

1.13

11.6

11.x

NFSoRDMA Supported Operating Systems on Client and Target Sides

  • SLES12 SP4

  • SLES12 SP5

  • SLES15 SP2

  • SLES15 SP3

  • Ubuntu 18.04

  • Ubuntu 20.04

  • Ubuntu 21.10

  • Ubuntu 22.04

  • RHEL 7.5

  • RHEL 7.6

  • RHEL 7.7

  • RHEL 7.8

  • RHEL 7.9

  • RHEL 8.1

  • RHEL 8.2

  • RHEL 8.4

  • RHEL 8.5

  • Kernel 5.17

  • RedHat 7.4

  • RedHat 7.5

  • RedHat 7.6

  • RedHat 7.7

  • RedHat 7.8

  • RedHat 7.9

  • RedHat 8.x

  • Oracle Linux 7.8

  • Oracle Linux 7.9

  • Oracle Linux 8.1

  • Oracle Linux 8.2

  • Oracle Linux 8.3

  • Fedora 32

  • SLES 12 SP3

  • SLES 12 SP4

  • SLES 12 SP5

  • SLES 15 SP1

  • SLES 15 SP2

  • SLES 15 SP3

  • Ubuntu 18.04

  • Ubuntu 20.04

  • Ubuntu 21

  • Debian 10

  • Debian 10.3

  • Rhel 8.x

  • Ubuntu 18.04

  • Ubuntu 20.04

  • Linux operating system

  • Administrator privileges on your machine(s)

  • Disk Space: 1GB

For the OFED Distribution to compile on your machine, some software packages of your operating
system (OS) distribution are required.
To install the additional packages, run the following commands per OS:

Operating System

Required Packages Installation Command

RHEL/Oracle Linux/Fedora

yum install perl pciutils python gcc-gfortran libxml2-python tcsh libnl.i686 libnl expat glib2 tcl libstdc++ bc tk gtk2 atk cairo numactl pkgconfig ethtool lsof

XenServer

yum install perl pciutils python libxml2-python libnl expat glib2 tcl bc libstdc++ tk pkgconfig ethtool

SLES 12

zypper install pkg-config expat libstdc++6 libglib-2_0-0 lib- gtk-2_0-0 tcl libcairo2 tcsh python bc pciutils libatk-1_0-0 tk python-libxml2 lsof libnl3-200 ethtool lsof

SLES 15

python ethtool libatk-1_0-0 python2-libxml2-python tcsh lib- stdc++6-devel-gcc7 libgtk-2_0-0 tcl libopenssl1_1 libnl3-200 make libcairo2 expat libmnl0 insserv-compat pciutils lsof lib- glib-2_0-0 pkg-config tk

Ubuntu/Debian

apt-get install perl dpkg autotools-dev autoconf libtool auto- make1.10 automake m4 dkms debhelper tcl tcl8.4 chrpath swig graphviz tcl-dev tcl8.4-dev tk-dev tk8.4-dev bison flex dpatch zlib1g-dev curl libcurl4-gnutls-dev python-libxml2 libvirt-bin libvirt0 libnl-dev libglib2.0-dev libgfortran3 automake m4

pkg-config libnuma logrotate ethtool lsof

Warning

As of version 5.1, ConnectX-3, ConnectX-3 Pro or Connect-IB NICs are no longer supported. To work with a version that supports these adapter cards, please refer to version 4.9 long-term support (LTS).

This current version is tested with the following NVIDIA NIC firmware versions:

Warning

Firmware versions listed are the minimum supported versions.

Adapter Card

Recommended Firmware Version

Additional Firmware Version Supported

BlueField®-2

24.33.1048

24.32.1010

BlueField

18.33.1048

18.32.1010

ConnectX-7

28.33.2028

N/A

ConnectX-6 Lx

26.33.1048

26.32.1010

ConnectX-6 Dx

22.33.1048

22.32.2004

ConnectX-6

20.33.1048

20.32.1010

ConnectX-5/ConnectX-5 Ex

16.33.1048

16.32.1010

ConnectX-4 Lx

14.32.1010

14.32.1010

ConnectX-4

12.28.2006

12.28.2006

For the official firmware versions, please see https://www.nvidia.com/en-us/networking/ → Support → Support → Firmware Download.

The following are the unsupported functionalities/features/NICs in the current version:

  • ConnectX-2 adapter card

  • ConnectX-3 adapter card

  • ConnectX-3 Pro adapter card

  • Connect-IB adapter card

  • Soft-RoCE

  • RDMA experimental verbs library (mlnx_lib)

  • Relational Database Service (RDS)

  • mthca InfiniBand driver

  • Ethernet IPoIB (eIPoIB)

© Copyright 2023, NVIDIA. Last updated on Nov 27, 2023.