BlueField DPU Administrator Quick Start Guide

NVIDIA BlueField-2 InfiniBand_Ethernet DPU User Guide

This page is tailored for system administrators wishing to install BlueField and perform sample administrative actions on it. For a quick start guide aimed at software developers wishing to develop applications on the BlueField DPU using the DOCA framework, please refer to the NVIDIA DOCA Developer Quick Start Guide.

Note

Not sure which guide to follow? For more details on the different BlueField user types, please refer to the NVIDIA BlueField and DOCA User Types document.

This section takes you through the basic steps of installing BlueField DPU and performing a sample administrative task on it.

  1. Install your DPU into your host server according to the instructions under Hardware Installation.

    Warning

    Ensure your host OS is included in the supported operating systems list and that the BlueField's out-of-band (OOB) management interface is connected to the network. The OOB interface must be connected to a DHCP/DNS server. The MAC address of the OOB port is found on the sticker on the BlueField DPU.

  2. Verify that the host server correctly identifies the BlueField DPU. The following commands rescan the PCIe bus and list the BlueField's name and PCIe address:

    Copy
    Copied!
                

    # sudo update-pciids # sudo lspci | grep BlueField

    The list of identified devices should include a network controller for every physical (Ethernet) port and a DMA controller for DPU management. Expected output example:

    Copy
    Copied!
                

    b3:00.0 Ethernet controller: Mellanox Technologies MT42822 BlueField-2 integrated ConnectX-6 Dx network controller (rev 01) b3:00.1 Ethernet controller: Mellanox Technologies MT42822 BlueField-2 integrated ConnectX-6 Dx network controller (rev 01) b3:00.2 DMA controller: Mellanox Technologies MT42822 BlueField-2 SoC Management Interface (rev 01)

  3. If an older DOCA software version is installed on your host, make sure to uninstall it before proceeding with the installation of the new version:

    • For Ubuntu/Debian:

      Copy
      Copied!
                  

      $ for f in $( dpkg --list | grep doca | awk '{print $2}' ); do echo $f ; apt remove --purge $f -y ; done $ sudo apt-get autoremove

    • For CentOS/RHEL/Rocky:

      Copy
      Copied!
                  

      host# for f in $(rpm -qa |grep -i doca ) ; do yum -y remove $f; done host# yum autoremove host# yum makecache

  4. Download and install the "DOCA for Host" package compatible with your specific operating system and version listed here under the "BlueField Drivers" tab.

    Warning

    Make sure to accept cookies from the website when prompted.

  5. Verify that the RShim tool, which loads BlueField DPU with updated images, is running on the host.

    Copy
    Copied!
                

    # sudo systemctl status rshim

    Expected output example:

    Copy
    Copied!
                

    rshim.service - rshim driver for BlueField SoC Loaded: loaded (/usr/lib/systemd/system/rshim.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2022-11-24 00:05:10 IST; 29 minutes ago

At this stage the host environment is all set and you can now perform administrative tasks on the DPU.

To connect to your DPU:

  1. SSH to the DPU using the OOB IP or the RShim IP (192.168.100.2) using the default credentials (ubuntu/ubuntu).

  2. When logging into the DPU for the first time after installing the BFB, you must change the default password.

    Copy
    Copied!
                

    WARNING: Your password has expired. You must change your password now and login again! Changing password for ubuntu. Current password: New password:

  3. To check the current running BFB:

    Copy
    Copied!
                

    dpu# sudo cat /etc/mlnx-release

Warning

These instructions are tailored for installing the BlueField BFB image on the default Ubuntu OS. To install it on other OSs, please contact NVIDIA Support.

The BlueField BFB image includes all the DOCA packages.

  1. Installing a new BFB on the DPU is performed using the bfb-install utility that is included in the RShim tool.

    Copy
    Copied!
                

    # bfb-install --bfb <BFB-image>.bfb --rshim rshim0

    Expected output example:

    Copy
    Copied!
                

    Pushing bfb Collecting BlueField booting status. Press Ctrl+C to stop… INFO[BL2]: start … INFO[MISC]: Ubuntu installation started INFO[MISC]: Installation finished INFO[MISC]: Rebooting...

  2. Upgrade the firmware of the BlueField DPU:

    1. Upgrade the BlueField DPU's firmware:

      Copy
      Copied!
                  

      dpu# sudo /opt/mellanox/mlnx-fw-updater/mlnx_fw_updater.pl --force-fw-update

      Expected output example:

      Copy
      Copied!
                  

      Device #1: ---------- Device Type: BlueField-2 [...] Versions: Current Available FW <Old_FW_ver> <New_FW_ver> [...] Done

    2. Power cycle the host for the changes to take effect.

  3. Verify that the BFB has been installed and the firmware has been upgraded successfully by accessing the DPU again:

    1. SSH to the BlueField DPU from the host using OOB IP or RShim IP:

      Copy
      Copied!
                  

      ssh <ip>

    2. Check the versions of the DPU image and firmware:

      Copy
      Copied!
                  

      # sudo bfvcheck

      Expected output example:

      Copy
      Copied!
                  

      Beginning version check...   -RECOMMENDED VERSIONS- ATF: v2.2(release):4.0.3-3-g886241c UEFI: 4.0.3-1-g2162ecf FW: 24.37.1300   -INSTALLED VERSIONS- ATF: v2.2(release):4.0.3-3-g886241c UEFI: 4.0.3-1-g2162ecf FW: 24.37.1300   Version check complete. No issues found.

© Copyright 2023, NVIDIA. Last updated on Sep 8, 2023.