Appendix A: Installing Software#

SUSE Linux Enterprise Server uses the Zypper package manager to install, update, and remove packages. The utility can also be used to manage repositories. For more information about using Zypper, refer to the SUSE Zypper Package Manager article.

A.1 NVIDIA DOCA-OFED#

NVIDIA MLNX_OFED has transitioned to DOCA-OFED. Refer to the following resources for more information:

To install NVIDIA DOCA-OFED on SLES 15:

Add the NVIDIA DOCA-OFED repository to your system.

sudo dd status=none of=/etc/zypp/repos.d/doca.repo << EOF [doca]
name=DOCA latest
baseurl=https://linux.mellanox.com/public/repo/doca/latest/sles15sp6/sbsa-arm64
/ enabled=1 gpgcheck=0
EOF
sudo zypper refresh

Install the dependent software.

sudo zypper install -y kernel-64kb-devel

Install the DOCA-Extra and build DOCA modules.

sudo zypper install -y doca-extra
sudo /opt/mellanox/doca/tools/doca-kernel-support

Install the DOCA modules and DOCA userspace.

The output from the previous command will have instructions about how to install the DOCA modules.`

The instructions will resemble the following output, but users need to provide the path, package name, and repository values.

sudo zypper install --no-recommends mlnx-ofa_kernel doca-ofed-userspace
sudo rpm -ivh /tmp/DOCA.<random value>/doca-kernel-repo-<version value>.rpm
sudo zypper refresh
REPOID=$(sudo zypper lr | grep doca-kernel | awk '{print $1}')
sudo zypper install -r $REPOID -y doca-kernel-<version value>.rpm

When using NVIDIA BlueField-3 SoC Management Interface, enable the Rshim service.

sudo systemctl daemon-reload
sudo systemctl enable rshim
sudo systemctl start rshim

To confirm that the NVIDIA BlueField-3 Soc Management Interface is on the system, run the following commands.

# Print the PCI BDF for the BlueField-3 Soc Management Interface
sudo lspci | grep "BlueField-3 SoC Management Interface" | awk '{print $1}'
0006:03:00.2
0016:03:00.2

Update the device firmware.
```
sudo zypper -y mlnx-fw-updater
```
If the NVIDIA BlueField-3 SoC Management Interface is on the system, install the BF-bundle.
```
sudo bfb-install --rshim rshim<N> --bfb <image_path.bfb>
```
Where <N> is the rshim device identifier.
Update the boot image to include NVIDIA DOCA-OFED support and reboot the system.
```
sudo dracut -f
sudo reboot now
```

A.2 NVIDIA GPU Driver and CUDA Toolkit#

Refer to the NVIDIA CUDA Installation Guide for Linux for instructions on how to install the NVIDIA GPU driver and NVIDIA CUDA® support for SLES. The R535.129.03 driver is the minimum level required for the Hopper GPU.

The following commands can be used to install the minimum levels required for the Hopper GPU:

sudo zypper remove -y nvidia-open-driver-G06-signed-kmp-64kb
sudo zypper install -y kernel-64kb-devel
sudo usermod -a -G video <username>
sudo zypper addrepo https://developer.download.nvidia.com/compute/cuda/repos/sles15/sbsa/cuda-sles15.repo
sudo zypper refresh
sudo zypper install -y cuda-toolkit-12-8
sudo SUSEConnect -p PackageHub/15.6/aarch64
sudo zypper install -y nvidia-open-64k-570
sudo systemctl enable nvidia-persistenced
sudo reboot now

Note

The open-source GPU driver is required for Hopper GPUs.