Installing MLNX_EN
The install installation script performs the following:
Discovers the currently installed kernel
Uninstalls any previously installed MLNX_EN package
Installs the MLNX_EN binary (if they are available for the current kernel)
Identifies the currently installed Ethernet network adapters and automatically upgrades the firmware
mlnx_en installer supports 2 modes of installation. The install script selects the mode of driver installation depending on the running OS/kernel version.
Kernel Module Packaging (KMP) mode, where the source rpm is rebuilt for each installed flavor of the kernel. This mode is used for RedHat and SUSE distributions.
Non KMP installation mode, where the sources are rebuilt with the running kernel. This mode is used for vanilla kernels.
By default, the package will install drivers supporting Ethernet only. In addition, the package will include the following new installation options:
Full VMA support which can be installed using the installation option “–vma”.
Infrastructure to run DPDK using the installation option “–dpdk”.
Notes:DPDK itself is not included in the package. Users would still need to install DPDK separately after the MLNX_EN installation is completed.
Installing VMA or DPDK infrastructure will allow users to run RoCE.
Installation Results
For Ethernet only installation mode:
The kernel modules are installed under:
/lib/modules/`uname -r`/updates on SLES and Fedora Distributions
/lib/modules/`uname -r`/extra/mlnx-en on RHEL and other RedHat like Distributions
/lib/modules/`uname -r`/updates/dkms/ on Ubuntu
The kernel module sources are placed under:
/usr/src/mlnx-en-<ver>/
For VPI installation mode:
The kernel modules are installed under:
/lib/modules/`uname -r`/updates on SLES and Fedora Distributions
/lib/modules/`uname -r`/extra/mlnx-ofa_kernel on RHEL and other RedHat like Distributions
/lib/modules/`uname -r`/updates/dkms/ on Ubuntu
The kernel module sources are placed under:
/usr/src/ofa_kernel-<ver>/
This section describes the installation procedure of MLNX_EN on Mellanox adapter cards. Additional installation procedures are provided for Mellanox Innova SmartNIC for other environment customizations, and for extra libraries and packages in Installing MLNX_EN on Innova™ IPsec Adapter Cards section.
Log into the installation machine as root.
Mount the ISO image on your machine.
host1# mount -o ro,loop mlnx-en-<ver>-<OS label>-<CPU arch>.iso /mnt
Run the installation script.
/mnt/install
Case A: If the installation script has performed a firmware update on your network adapter, you need to either restart the driver or reboot your system before the firmware update can take effect. Refer to the table below to find the appropriate action for your specific card.
Action \ Adapter
Driver Restart
Standard Reboot (Soft Reset)
Cold Reboot (Hard Reset)
ConnectX-3/ConnectX-3 Pro
+
-
-
Standard ConnectX-4/ConnectX-4 Lx or higher
-
+
-
Adapters with Multi-Host Support
-
-
+
Socket Direct Cards
-
-
+
Case B: If the installations script has not performed a firmware upgrade on your network adapter, restart the driver by running:
# /etc/init.d/mlnx-en.d restart - after Ethernet only installation mode
# /etc/init.d/openibd restart - after VPI installation mode
The “/etc/init.d/openibd” service script will load the mlx4 and/or mlx5 and ULP drivers as set in the “/etc/infiniband/openib.conf” configuration file.
The result is a new net-device appearing in the 'ifconfig -a' output.
Installing MLNX_EN on Innova™ IPsec Adapter Cards
This type of installation is applicable to RedHat 7.1, 7.2, 7.3 and 7.4 operating systems and Kernel 4.13.
As of version 4.2, MLNX_EN supports Mellanox Innova IPsec EN adapter card that provides security acceleration for IPsec-enabled networks.
For information on the usage of Innova IPsec, please refer to Mellanox Innova IPsec EN Adapter Card documentation on Mellanox official web (mellanox.com --> Products --> Adapters --> Smart Adapters --> Innova IPsec).
Prerequisites
In order to obtain Innova IPsec offload capabilities once MLNX_EN is installed, make sure Kernel v4.13 or newer is installed with the following configuration flags enabled:
CONFIG_XFRM_OFFLOAD
CONFIG_INET_ESP_OFFLOAD
CONFIG_INET6_ESP_OFFLOAD
Installing MLNX_EN Using YUM
This type of installation is applicable to RedHat/OL, Fedora, XenServer operating systems.
Setting up MLNX_EN YUM Repository
The package consists of two folders that can be set up as a repository:
“RPMS_ETH” - provides the Ethernet only installation mode
“RPMS” - provides the RDMA support installation mode
Log into the installation machine as root.
Mount the ISO image on your machine and copy its content to a shared location in your network.
# mount -o ro,loop mlnx-en-<ver>-<OS label>-<CPU arch>.iso /mnt
You can download the image from www.mellanox.com --> Products --> Software --> Ethernet Drivers.
Download and install Mellanox Technologies GPG-KEY:
The key can be downloaded via the following link:
http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-MellanoxExample:
# wget http:
//www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox
--2014
-04
-20
13
:52
:30
-- http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox
Resolving www.mellanox.com...72.3
.194.0
Connecting to www.mellanox.com|72.3
.194.0
|:80
... connected. HTTP request sent, awaiting response...200
OK Length:1354
(1
.3K) [text/plain] Saving to: ?RPM-GPG-KEY-Mellanox?100
%[=================================================>]1
,354
--.-K/s in 0s2014
-04
-20
13
:52
:30
(247
MB/s) - ?RPM-GPG-KEY-Mellanox? saved [1354
/1354
]Install the key.
Example:# sudo rpm --
import
RPM-GPG-KEY-Mellanox warning: rpmts_HdrFromFdno: Header V3 DSA/SHA1 Signature, key ID 6224c050: NOKEY Importing GPG key0x6224C050
: Userid:"Mellanox Technologies (Mellanox Technologies - Signing Key v2) <support@mellanox.com>"
From : /repos/MLNX_EN/RPM-GPG-KEY-Mellanox Isthis
ok [y/N]:Check that the key was successfully imported.
Example:# rpm -q gpg-pubkey --qf
'%{NAME}-%{VERSION}-%{RELEASE}\t%{SUMMARY}\n'
| grep Mellanox gpg-pubkey-a9e4b643-520791ba gpg(Mellanox Technologies <support@mellanox
.com>) Rev3.30
Mellanox Technologies45
Create a YUM repository configuration file called “/etc/yum.repos.d/mlnx_en.repo” with the following content:
[mlnx_en] name=MLNX_EN Repository baseurl=file:
///<path to extracted MLNX_EN package>/<RPMS FOLDER NAME>
enabled=1
gpgkey=file:///<path to the downloaded key RPM-GPG-KEY-Mellanox>
gpgcheck=1
WarningReplace <RPMS FOLDER NAME> with “RPMS_ETH” or “RPMS” depending on the desired installation mode (Ethernet only or RDMA).
Check that the repository was successfully added.
# yum repolist Loaded plugins: product-id, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. repo id repo name status mlnx_en MLNX_EN Repository
Installing MLNX_EN Using the YUM Tool
After setting up the YUM repository for MLNX_EN package, install one of the following metadata packages:
In case you set up the “RPMS_ETH” folder as the repository (for Ethernet only mode), install:
# yum install mlnx-en-eth-only
In case you set up the “RPMS” folder as the repository (for RDMA mode), install either:
# yum install mlnx-en-vma
Or
# yum install mlnx-en-dpdk
Please note the following:
MLNX_EN provides kernel module RPM packages with KMP support for RHEL and SLES. For other operating systems, kernel module RPM packages are provided only for the operating system’s default kernel. In this case, the group RPM packages have the supported kernel version in their packages name.
If you have an operating systems different than RHEL or SLES, or you have installed a kernel that is not supported by default in MLNX_EN, you can use the mlnx_add_kernel_support.sh script to build MLNX_EN for your kernel.
The script will automatically build the matching group RPM packages for your kernel so that you can still install MLNX_EN via YUM.
Please note that the resulting MLNX_EN repository will contain unsigned RPMs. Therefore, you should set 'gpgcheck=0' in the repository configuration file.
Installing MLNX_EN using the YUM tool does not automatically update the firmware.
To update the firmware to the version included in MLNX_EN package, you can either:
Run:
# yum install mlnx-fw-updater
OR
Update the firmware to the latest version available on Mellanox website as described in Updating Firmware After Installation section.
Installing MLNX_EN Using apt-get
This type of installation is applicable to Debian and Ubuntu operating systems.
Setting up MLNX_EN apt-get Repository
The package consists of two folders that can be set up as a repository:
“DEBS_ETH” - provides the Ethernet only installation mode.
“RPMS” - provides the RDMA support installation mode.
Log into the installation machine as root.
Extract the MLNX_EN package on a shared location in your network.
You can download it from http://www.mellanox.com > Products > Software> Ethernet Drivers.Create an apt-get repository configuration file called "/etc/apt/sources.list.d/mlnx_en.list" with the following content:
deb file:/<path to extracted MLNX_EN
package
>/<DEBS FOLDER NAME> ./WarningReplace <DEBS FOLDER NAME> with “DEBS_ETH” or “DEBS” depending on the desired installation mode (Ethernet only or RDMA).
Download and install Mellanox Technologies GPG-KEY.
Example:# wget -qO - http:
//www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox | sudo apt-key add -
Verify that the key was successfully imported.
Example:# apt-key list pub 1024D/A9E4B643
2013
-08
-11
uid Mellanox Technologies <support@mellanox
.com> sub 1024g/09FCC2692013
-08
-11
Update the apt-get cache.
# sudo apt-get update
Installing MLNX_EN Using the apt-get Tool
After setting up the apt-get repository for MLNX_EN package, install one of the following metadata packages:
In case you set up the “DEBS_ETH” folder as the repository (for Ethernet only mode), install:
# apt-get install mlnx-en-eth-only
In case you set up the “DEBS” folder as the repository (for RDMA mode), install either:
# apt-get install mlnx-en-vma
OR
# apt-get install mlnx-en-dpdk
Installing MLNX_EN using the apt-get tool does not automatically update the firmware. To update the firmware to the version included in MLNX_EN package, you can either:
Run:
# apt-get install mlnx-fw-updater
Or
Update the firmware to the latest version available on Mellanox website as described in Updating Firmware After Installation section.