Release Notes

Note

Software upgrades are cumulative, which means that your systems will always receive the latest versions of all installed software components. The packages in the repositories can also be newer than the current DGX OS release. Read and evaluate the information and advisories from all relevant releases and later upgrades.

Current Software Versions

The following table shows the current version information of the software packages provided in the NVIDIA and Ubuntu repositories for the NVIDIA DGX Software Stack.

Component

Version

Additional Information

CUDA Toolkit and GPU Driver

CUDA Toolkit 12.2 and R535TeslaRD5 535.129.03

CUDA Toolkit 11.4 and R470TeslaRD10 470.223.02

The default driver included in the DGX OS ISO is 535.54.03.

CUDA Toolkit is only installed by default for DGX Stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

NCCL

2.18.3

cuDNN

8.9.1 or later

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

23.06.02

Refer to the NVIDIA System Management Documentation

Docker Engine

23.0.4

NVIDIA Container Toolkit

1.13.5

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.5

  • libnvidia-container1: 1.13.5

  • nvidia-container-toolkit: 1.13.5

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd.

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.06

GDRCopy

2.3.1

ISO

DGXOS-6.1.0-2023-08-09-12-30-10.iso

MD5 Checksum

d38620ffa58905330c1efe49b3d7ff53

The following table provides information about the supported OS and matching firmware versions for Mellanox OFED.

OS

DGX-1, DGX-2

ConnectX-4 or ConnectX-5

DGX A100

ConnectX-6 (CX-6)

DGX A100

ConnectX-7 (CX-7)

DGX H100

Connectx-7 (CX-7)

Ubuntu 22.04

5.8-3.0.7.0

  • CX-5: 16.35.3006

  • CX-4: 12.28.2006

5.8-3.0.7.0

  • CX-6: 20.35.3006

5.4-3.7.5.0

  • CX-7: 28.34.4000

5.9-0.5.6.0.127

  • CX-7: 28.36.2050

Mellanox OFED is not installed by default. If Mellanox OFED is not installed, Mellanox Firmware is not automatically updated.

To install the Mellanox OFED driver instead of the OFED drivers, after you perform the upgrade, refer to Installing the Mellanox OFED Drivers.

In addition to upgrading to the versions described in this section, performing a package upgrade can update the software component versions, the Ubuntu 22.04 LTS version, and Ubuntu kernel, depending on when you perform the upgrade.

Note

For information about LTS software versions for related networking components, refer to the Networking Long-Term Support Releases page.

Important

This release incorporates the following updates:

  • Ubuntu ConnectX drivers and OFED stack.

  • Customers are advised to consider these updates and any effect they might have on their application. For example, some MOFED-dependent applications can be affected.

  • Best practices support upgrading select systems and verifying that your applications are working as expected before you deploy on additional systems.

Supported DGX Systems

DGX OS 6 supports the following systems:

  • DGX H100 (requires DGX OS ISO 6.0.11 or later)

  • DGX H800 (requires DGX OS ISO 6.1.0 or later)

  • DGX A100

  • DGX A800

  • DGX Station A100

  • DGX-2 (V100)

  • DGX-1 (V100)

  • DGX Station (V100)

  • DGX Station A800

Update History

This section provides information about important updates to DGX OS 6.

DGX OS 6.1.0 Release: August 11, 2023

  • The DGX OS ISO 6.1.0 has been released.

  • The following changes were made to the repositories and the ISO

    • Added support for DGX H800.

    • Kernel update to 5.15.0-1029-nvidia.

    • The gdrcopy packages are removed from ISO but are still available from the repository.

    • The gdrcopy packages can be installed as an option but are no longer installed by default.

    • The dgx-h100-ota-update-meta package is updated to 23.07.1.

    • The nvidia-manage-ofed package is updated to 23.07-1.

    • NVSM is updated to 23.06.2.

    • NVIDIA CUDA Toolkit is updated to 12.2.0.

    • NVIDIA Container Toolkit is updated to 1.13.5.

DGX OS 6.0.11 Release: May 17, 2023

  • Added support for DGX H100

  • The DGX OS ISO 6.0.11 has been released.

  • The following changes were made to the repositories and the ISO

  • Kernel version updated to 5.15.0-1025.25

  • NVSM updated to 22.12.06

DGX OS 6.0.10 Release: May 3, 2023

DGX OS ISO Releases

This section lists all DGX OS ISO releases with the software versions included in the image.

DGX OS ISO 6.1.0

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1029-nvidia

GPU Driver

R535: 535.54.03

CUDA Toolkit

12.2.0

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.18.3

cuDNN

8.9.1

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

23.06.02

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.5

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.5-1

  • libnvidia-container1: 1.13.5-1

  • nvidia-container-toolkit: 1.13.5-1

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.06

ISO

DGXOS-6.1.0-2023-08-09-12-30-10.iso

MD5 Checksum

d38620ffa58905330c1efe49b3d7ff53

DGX OS ISO 6.0.11

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1025.25

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.06

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.11-2023-05-16-16-18-31.iso

MD5 Checksum

21d73f97b1e8d3efc15eddabb53c4f17

DGX OS ISO 6.0.10

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1023.23

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.04

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.10-2023-05-02-19-06-32.iso

MD5 Checksum

55ae2430a4ca490e0383f3740a39941e