Release Notes

Note

Software upgrades are cumulative, which means that your systems will always receive the latest versions of all installed software components. The packages in the repositories can also be newer than the current DGX OS release. Read and evaluate the information and advisories from all relevant releases and later upgrades.

Current Software Versions

The following table shows the current version information of the software packages provided in the NVIDIA and Ubuntu repositories for the NVIDIA DGX Software Stack.

Current Software Versions (Last Updated on April 19, 2024)

Component

Version

Additional Information

GPU Driver

R550TeslaRD2 (550.54.15)

GPU Driver

R535TeslaRD8 (535.161.08)

GPU Driver

R470TeslaRD11 (470.239.06)

For RHEL8 and DGX OS 5 only.

CUDA Toolkit

CUDA Toolkit 12.4

R550: 12.4 download

CUDA Toolkit

CUDA Toolkit 12.2 Update 2

R535: 12.2 update 2 download

CUDA Toolkit

CUDA Toolkit 11.4

R470: For RHEL8 and DGX OS 5 only.

MLNX_OFED

23.10-2.1.3.1

23.10-2.1.3.1 download

Inbox OFED

39.0-1

For DGX OS 6 only.

NCCL

2.21.5

cuDNN

9.1.0

DCGM

3.3.5

GPUDirect Storage (GDS)

  • 1.9 for CUDA Toolkit 12.4

  • 1.7.2 for CUDA Toolkit 12.2 Update 2

  • 1.0 for CUDA Toolkit 11.4

NVIDIA Container Toolkit

1.14.6

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.14.6

  • libnvidia-container1: 1.14.6

  • nvidia-container-toolkit: 1.14.6

nvidia-peer-memory

1.3

Note

  • CUDA Toolkit is installed by default only for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

  • For CUDA Toolkit minor version compatibility and the minimum required driver version, refer to CUDA Compatibility.

The following table provides information about the supported OS and matching firmware versions for NVIDIA® OpenFabrics Enterprise Distribution for Linux (MLNX_OFED) version 23.10-2.1.3.1. For more information about this long-term support (LTS) release, refer to

Supported OS and Matching Firmware Versions (Last Updated on April 19, 2024)
OS
DGX-1, DGX-2
ConnectX-4 (CX-4) or
ConnectX-5 (CX-5)
DGX A100
ConnectX-6
DGX A100
ConnectX-7
DGX H100
ConnectX-7
Ubuntu 22.04
DGX OS 6

CX-5: 16.35.3006

CX-4: 12.28.2006

20.39.3004

28.39.3004

28.39.3004

Ubuntu 20.04
DGX OS 5

CX-5: 16.35.3006

CX-4: 12.28.2006

20.39.3004

28.39.3004

Not applicable

RHEL 9 and
RHEL 8

CX-5: 16.35.3006

CX-4: 12.28.2006

20.39.3004

28.39.3004

28.39.3004

COSS 9

Not applicable

20.39.3004

Not applicable

Not applicable

For installation instructions, refer to

In addition to upgrading to the versions described in this section, performing a package upgrade can update the software component versions, the Ubuntu 22.04 LTS version, and Ubuntu kernel, depending on when you perform the upgrade.

Note

For information about LTS software versions for related networking components, refer to the Networking Long-Term Support Releases page.

Important

This release incorporates the following updates:

  • Ubuntu ConnectX drivers and OFED stack.

  • Customers are advised to consider these updates and any effect they might have on their application. For example, some MOFED-dependent applications can be affected.

  • Best practices support upgrading select systems and verifying that your applications are working as expected before you deploy on additional systems.

Supported DGX Systems

DGX OS 6 supports the following systems:

  • DGX H100 (requires DGX OS ISO 6.0.11 or later)

  • DGX H800 (requires DGX OS ISO 6.1.0 or later)

  • DGX A100 640 GB

  • DGX A100 320 GB

  • DGX A800 640 GB

  • DGX Station A100 320 GB

  • DGX Station A100 160 GB

  • DGX Station A800 320 GB

  • DGX-2

  • DGX-1 (V100)

  • DGX Station (V100)

Update History

This section provides information about important updates to DGX OS 6.

DGX OS 6.2.0 Release: March 22, 2024

Here are the new features in DGX OS 6.2.0:

  • The DGX OS ISO 6.2.0 has been released.

  • Added support for single-port ConnectX-7 VPI adapter card for DGX A100 System.

  • Support for MLNX_OFED LTS version 23.10-2.1.3.1.

  • Continued support for DGX H100 and DGX H800.

  • The following changes were made to the repositories and the ISO:

    • OS base: 22.04.3 LTS

    • Kernel: 5.15.0-1046-nvidia

    • NVIDIA GPU Driver: 535.161.07

    • CUDA Toolkit: 12.2-1

    • NCCL: 2.20.3

    • cuDNN: 8.9.7

    • DCGM: 3.3.5

    • GPUDirect Storage: 1.7.2

    • NVSM: 23.12.01

    • Docker Engine: 24.0.7-1

    • NVIDIA Container Toolkit: 1.14.6

    • MIG Configuration Tool: 0.5.5

    • NGC CLI: 3.36.0

    • DLFW: 24.01

    • GDRCopy: 2.4.1

DGX OS 6.1.0 Release: August 11, 2023

  • The DGX OS ISO 6.1.0 has been released.

  • The following changes were made to the repositories and the ISO

    • Added support for DGX H800.

    • Kernel update to 5.15.0-1029-nvidia.

    • The gdrcopy packages are removed from ISO but are still available from the repository.

    • The gdrcopy packages can be installed as an option but are no longer installed by default.

    • The dgx-h100-ota-update-meta package is updated to 23.07.1.

    • The nvidia-manage-ofed package is updated to 23.07-1.

    • NVSM is updated to 23.06.2.

    • NVIDIA CUDA Toolkit is updated to 12.2.0.

    • NVIDIA Container Toolkit is updated to 1.13.5.

DGX OS 6.0.11 Release: May 17, 2023

  • Added support for DGX H100

  • The DGX OS ISO 6.0.11 has been released.

  • The following changes were made to the repositories and the ISO

  • Kernel version updated to 5.15.0-1025.25

  • NVSM updated to 22.12.06

DGX OS 6.0.10 Release: May 3, 2023

DGX OS ISO Releases

This section lists all DGX OS ISO releases with the software versions included in the image.

DGX OS ISO 6.2.0

Component

Version

Notes

Ubuntu

Ubuntu 22.04.3 LTS

Base OS 6.2.0

Ubuntu Kernel

5.15.0-1046-nvidia

GPU Driver

R535TeslaRD7 535.161.07

CUDA Toolkit

CUDA Toolkit 12.2.1

CUDA Toolkit is only installed by default for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

Inbox OFED

39.0-1

NCCL

2.20.3

cuDNN

8.9.7

DCGM

3.3.5

GPUDirect Storage (GDS)

1.7.2

NVIDIA Container Toolkit

1.14.6

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.14.6

  • libnvidia-container1: 1.14.6

  • nvidia-container-toolkit: 1.14.6

NVSM

23.12.01

Docker Engine

24.0.7-1

GDRCopy

2.4.1

MIG Configuration Tool

0.5.5

NGC CLI

3.36.0

DLFW (BM)

24.01

ISO

DGXOS-6.2.0-2024-03-15-14-25-26.iso

MD5 Checksum

ecd6c5f77d957d41c8132a0d3941cf8c

DGX OS ISO 6.1.0

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1029-nvidia

GPU Driver

R535: 535.54.03

CUDA Toolkit

12.2.0

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.18.3

cuDNN

8.9.1

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

23.06.02

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.5

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.5-1

  • libnvidia-container1: 1.13.5-1

  • nvidia-container-toolkit: 1.13.5-1

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.06

ISO

DGXOS-6.1.0-2023-08-09-12-30-10.iso

MD5 Checksum

d38620ffa58905330c1efe49b3d7ff53

DGX OS ISO 6.0.11

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1025.25

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.06

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.11-2023-05-16-16-18-31.iso

MD5 Checksum

21d73f97b1e8d3efc15eddabb53c4f17

DGX OS ISO 6.0.10

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1023.23

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.04

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.10-2023-05-02-19-06-32.iso

MD5 Checksum

55ae2430a4ca490e0383f3740a39941e