Updating ConnectX-8 and BlueField-3 Firmware#

After replacing or installing the ConnectX-8 and BlueField-3 cards, ensure the cards are running the latest firmware.

  1. Navigate to the NVIDIA Networking Firmware Downloads page.

    • For ConnectX-8, from the ConnectX Adapter Cards Firmware table, click the InfiniBand/Ethernet network protocol.

    • For NVIDIA BlueField-3, from the NVIDIA BlueField DPU Firmware table, click the InfiniBand/Ethernet network protocol.

  2. Select the OPN (ordering part number) and PSID for your configuration, using the following example as a guide.

    Adapter Card

    OPN

    PSID

    ConnectX-8

    MCX750500B-0D00

    MT_0000000891

    BlueField-3

    900-9D3B6-00CN-A

    MT_0000000883

    Note

    PSID (Parameter-Set Identification) is a 16-ascii character string embedded in the firmware image, which provides a unique identification for the configuration of the firmware.

  3. Download the firmware for both OPN options.

  4. Transfer the firmware ZIP file to the DGX system and extract the archive.

  5. Update the firmware on the cards that are used for cluster communication.

    For example,

    sudo mlxfwmanager -d ed:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d 97:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d dc:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d b9:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d 17:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d 70:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d 39:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    sudo mlxfwmanager -d 5f:00.0 -i fw-ConnectX8-rel-40_46_5500-900-9X85E-00NX-MC0_Ax-UEFI-14.39.14-FlexBoot-3.8.100.signed.bin
    
  6. Update the firmware on the cards that are used for storage communication.

    For example,

    sudo mlxfwmanager -d cc:00.0 -i fw-BlueField-3-rel-32_47_1026-900-9D3B6-00CN-A_Ax-NVME-20.4.1-UEFI-21.4.13-UEFI-22.4.14-UEFI-14.40.10-FlexBoot-3.8.201.signed.bin
    sudo mlxfwmanager -d 53:00.0 -i fw-BlueField-3-rel-32_47_1026-900-9D3B6-00CN-A_Ax-NVME-20.4.1-UEFI-21.4.13-UEFI-22.4.14-UEFI-14.40.10-FlexBoot-3.8.201.signed.bin
    
  7. Perform an AC power cycle on the system for the firmware update to take effect.

    Wait for the operating system to boot.

  8. After the system starts, log in and confirm the firmware versions are all the same:

    $ cat /sys/class/infiniband/mlx5_*/fw_ver
    

Automated Firmware Alignment#

Alternatively, use the DOCA-OFED installation instructions to update the firmware without manual downloads.

  1. Follow the steps outlined in Installing the Latest DOCA-OFED Package to ensure your software repositories are correctly configured.

    During the installation, the mlnx-fw-updater package is installed by default. The firmware manager automatically performs a firmware check and updates supported NICs to ensure they align with the validated versions for that specific DOCA release.

  2. Perform an AC power cycle on the system for the firmware update to take effect.

    Wait for the operating system to boot.

Additional Information#

For more information on the following topics, refer to