Updating ConnectX-8 and BlueField-3 Firmware#
After replacing or installing the ConnectX-8 and BlueField-3 cards, ensure the cards are running the latest firmware.
Navigate to the NVIDIA Networking Firmware Downloads page.
For ConnectX-8, from the ConnectX Adapter Cards Firmware table, click the InfiniBand/Ethernet network protocol.
For NVIDIA BlueField-3, from the NVIDIA BlueField DPU Firmware table, click the InfiniBand/Ethernet network protocol.
Select the OPN (ordering part number) and PSID for your configuration, using the following example as a guide.
Adapter Card
OPN
PSID
ConnectX-8
MCX750500B-0D00
MT_0000000891
BlueField-3
900-9D3B6-00CN-A
MT_0000000883
Note
PSID (Parameter-Set Identification) is a 16-ascii character string embedded in the firmware image, which provides a unique identification for the configuration of the firmware.
Download the firmware for both OPN options.
Transfer the firmware ZIP file to the DGX system and extract the archive.
Update the firmware on the cards that are used for cluster communication.
For example,
sudo mlxfwmanager -d ed:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d 97:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d dc:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d b9:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d 17:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d 70:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d 39:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin sudo mlxfwmanager -d 5f:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
Update the firmware on the cards that are used for storage communication.
For example,
sudo mlxfwmanager -d cc:00.0 -i fw-BlueField-3-rel-32_47_1026-900-9D3B6-00CN-A_Ax-NVME-20.4.1-UEFI-21.4.13-UEFI-22.4.14-UEFI-14.40.10-FlexBoot-3.8.201.signed.bin sudo mlxfwmanager -d 53:00.0 -i fw-BlueField-3-rel-32_47_1026-900-9D3B6-00CN-A_Ax-NVME-20.4.1-UEFI-21.4.13-UEFI-22.4.14-UEFI-14.40.10-FlexBoot-3.8.201.signed.bin
Perform an AC power cycle on the system for the firmware update to take effect.
Wait for the operating system to boot.
After the system starts, log in and confirm the firmware versions are all the same:
$ cat /sys/class/infiniband/mlx5_*/fw_ver
Automated Firmware Alignment#
Alternatively, use the DOCA-OFED installation instructions to update the firmware without manual downloads.
Follow the steps outlined in Installing the Latest DOCA-OFED Package to ensure your software repositories are correctly configured.
During the installation, the
mlnx-fw-updaterpackage is installed by default. The firmware manager automatically performs a firmware check and updates supported NICs to ensure they align with the validated versions for that specific DOCA release.Perform an AC power cycle on the system for the firmware update to take effect.
Wait for the operating system to boot.
Additional Information#
For more information on the following topics, refer to