Release Notes

Note

Software upgrades are cumulative, which means that your systems will always receive the latest versions of all installed software components. The packages in the repositories can also be newer than the current DGX OS release. Read and evaluate the information and advisories from all relevant releases and later upgrades.

Current Software Versions

The following table shows key software components and initially released versions for DGX OS 6:

Component

Version

Additional Information

GPU Driver

535.54.03

CUDA Toolkit

12.2.0

CUDA Toolkit is only installed by default for DGX Stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

NCCL

2.18.3

cuDNN

8.9.1 or later

DCGM

3.1.8

Mellanox OFED (MOFED)

5.9-0.5.6.0.125 for DGX H100 with NVIDIA ConnectX-7

5.4-3.7.5.0 for DGX A100 with NVIDIA ConnectX-7

5.8-3.0.7.0 for DGX A100 with NVIDIA ConnectX-6

5.8-3.0.7.0 for all other DGX systems

Mellanox OFED is not installed by default.

To install the Mellanox OFED driver instead of the OFED drivers, after you perform the upgrade, refer to Installing the Mellanox OFED Drivers.

For information about LTS software versions for related networking components, refer to the Networking Long-Term Support Releases page.

Inbox OFED

39.0-1

MLNX FW

28.36.2050 for DGX H100 with NVIDIA ConnectX-7

28.34.4000 for DGX A100 with NVIDIA ConnectX-7

28.35.3006 for DGX A100 with NVIDIA ConnectX-6

16.35.3006 for all systems with NVIDIA ConnectX-5

12.28.2006 for all systems with NVIDIA ConnectX-4

If Mellanox OFED is not installed, then Mellanox Firmware is not automatically updated.

GPUDirect Storage (GDS)

2.15.1

NVSM

23.06.02

Refer to the NVIDIA System Management Documentation

Docker Engine

23.0.4

NVIDIA Container Toolkit

1.13.5

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.5

  • libnvidia-container1: 1.13.5

  • nvidia-container-toolkit: 1.13.5

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd.

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.06

In addition to upgrading to the versions described in this section, performing a package upgrade can update the software component versions, the Ubuntu 22.04 LTS version, and Ubuntu kernel, depending on when you perform the upgrade.

Important

This release incorporates the following updates:

  • Ubuntu ConnectX drivers and OFED stack.

  • Customers are advised to consider these updates and any effect they might have on their application. For example, some MOFED-dependent applications can be affected.

  • Best practices support upgrading select systems and verifying that your applications are working as expected before you deploy on additional systems.

Supported DGX Systems

DGX OS 6 supports the following systems:

  • DGX H100 (requires DGX OS ISO 6.0.11 or later)

  • DGX H800 (requires DGX OS ISO 6.1.0 or later)

  • DGX A100

  • DGX A800

  • DGX Station A100

  • DGX-2 (V100)

  • DGX-1 (V100)

  • DGX Station (V100)

  • DGX Station A800

Update History

This section provides information about the updates to DGX OS 6. The updates listed include:

  • Major component updates in the Ubuntu repositories.

  • NVIDIA driver updates in the Ubuntu repositories

DGX OS 6.1.0 Release: August 11, 2023

  • The DGX OS ISO 6.1.0 has been released.

  • The following changes were made to the repositories and the ISO

    • Added support for DGX H800.

    • Kernel update to 5.15.0-1029-nvidia.

    • The gdrcopy packages are removed from ISO but are still available from the repository.

    • The gdrcopy packages can be installed as an option but are no longer installed by default.

    • The dgx-h100-ota-update-meta package is updated to 23.07.1.

    • The nvidia-manage-ofed package is updated to 23.07-1.

    • NVSM is updated to 23.06.2.

    • NVIDIA CUDA Toolkit is updated to 12.2.0.

    • NVIDIA Container Toolkit is updated to 1.13.5.

DGX OS 6.0.11 Release: May 17, 2023

  • Added support for DGX H100

  • The DGX OS ISO 6.0.11 has been released.

  • The following changes were made to the repositories and the ISO

  • Kernel version updated to 5.15.0-1025.25

  • NVSM updated to 22.12.06

DGX OS 6.0.10 Release: May 3, 2023

DGX OS ISO Releases

This section lists all DGX OS ISO releases with the software versions included in the image.

DGX OS ISO 6.1.0

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1029-nvidia

GPU Driver

R535: 535.54.03

CUDA Toolkit

12.2.0

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.18.3

cuDNN

8.9.1

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

23.06.02

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.5

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.5-1

  • libnvidia-container1: 1.13.5-1

  • nvidia-container-toolkit: 1.13.5-1

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.06

ISO

DGXOS-6.1.0-2023-08-09-12-30-10.iso

MD5 Checksum

d38620ffa58905330c1efe49b3d7ff53

DGX OS ISO 6.0.11

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1025.25

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.06

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.11-2023-05-16-16-18-31.iso

MD5 Checksum

21d73f97b1e8d3efc15eddabb53c4f17

DGX OS ISO 6.0.10

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1023.23

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.04

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.10-2023-05-02-19-06-32.iso

MD5 Checksum

55ae2430a4ca490e0383f3740a39941e