Release Notes#

Note

Software upgrades are cumulative, which means that your systems will always receive the latest versions of all installed software components. The packages in the repositories can also be newer than the current DGX OS release. Read and evaluate the information and advisories from all relevant releases and later upgrades.

Current Software Versions#

The following table shows the current version information of the software packages provided in the NVIDIA and Ubuntu repositories for the NVIDIA DGX Software Stack.

Current Software Versions (Last Updated on November 19, 2024)#

Component

Version

Additional Information

GPU Driver

550.127.08
EL8: RPM installer
EL9: RPM installer

GPU Driver

535.216.03
EL8: RPM installer
EL9: RPM installer

CUDA Toolkit

12.4 Update 1

R550: 12.4 Update 1 download

CUDA Toolkit

12.2 Update 2

R535: 12.2 Update 2 download

MLNX_OFED

24.10-0.7.0.0 LTS

24.10-0.7.0.0 download

DOCA OFED

2.9.0

2.9.0 download

Inbox OFED

39.0-1

For DGX OS 6 only.

NCCL

2.23.4

cuDNN

9.5.1

DCGM

3.3.9

GPUDirect Storage (GDS)

  • 1.11.1 for CUDA Toolkit 12.6 Update 2

  • 1.11 for CUDA Toolkit 12.6

  • 1.10 for CUDA Toolkit 12.5

  • 1.9 for CUDA Toolkit 12.4

  • 1.8 for CUDA Toolkit 12.3

  • 1.7 for CUDA Toolkit 12.2

  • 1.0 for CUDA Toolkit 11.4

NVIDIA Container Toolkit

1.16.2

NVIDIA Container Toolkit includes the following packages:

  • nvidia-container-toolkit: 1.16.2

  • libnvidia-container-tools: 1.16.2

  • libnvidia-container1: 1.16.2

nvidia-peer-memory

1.3

Note

  • CUDA Toolkit is installed by default only for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

  • For CUDA Toolkit minor version compatibility and the minimum required driver version, refer to CUDA Compatibility.

The following table provides information about the matching firmware versions for NVIDIA® OpenFabrics Enterprise Distribution for Linux (MLNX_OFED) version 24.10-0.7.0.0. For more information about this long-term support (LTS) release, refer to

Matching Firmware Versions (Last Updated on November 19, 2024)#
DGX-1, DGX-2
ConnectX-4 (CX-4) or
ConnectX-5 (CX-5)
DGX A100
ConnectX-6
DGX A100
ConnectX-7
DGX H100/H200
ConnectX-7

CX-5: 16.35.4030

CX-4: 12.28.2006

20.39.3560

28.39.3560

28.39.3560

For installation instructions, refer to

In addition to upgrading to the versions described in this section, performing a package upgrade can update the software component versions, the Ubuntu 22.04 LTS version, and Ubuntu kernel, depending on when you perform the upgrade.

Note

For information about LTS software versions for related networking components, refer to the Networking Long-Term Support Releases page.

Important

This release incorporates the following updates:

  • Ubuntu ConnectX drivers and OFED stack.

  • Customers are advised to consider these updates and any effect they might have on their application. For example, some MOFED-dependent applications can be affected.

  • Best practices support upgrading select systems and verifying that your applications are working as expected before you deploy on additional systems.

Supported DGX Systems#

DGX OS 6 supports the following systems:

  • DGX H200 (requires DGX OS ISO 6.3.1)

  • DGX H100 (requires DGX OS ISO 6.0.11 or later)

  • DGX H800 (requires DGX OS ISO 6.1.0 or later)

  • DGX A100 640 GB

  • DGX A100 320 GB

  • DGX A800 640 GB

  • DGX Station A100 320 GB

  • DGX Station A100 160 GB

  • DGX Station A800 320 GB

  • DGX-2

  • DGX-1 (V100)

  • DGX Station (V100)

Latest Release#

DGX OS 6.3.1 (September 17, 2024)#

This release introduces the following new features and updates:

Previous Releases#

This section provides information about important updates to DGX OS 6.

DGX OS 6.3.0 (August 9, 2024)#

This release introduces the following new features and updates:

DGX OS 6.2.1 (May 2, 2024)#

This release introduces the following new features and updates:

  • The DGX OS ISO 6.2.1 has been released.

  • The following changes were made to the repositories and the ISO:

DGX OS 6.2.0 (March 22, 2024)#

This release introduces the following new features and updates:

  • The DGX OS ISO 6.2.0 has been released.

  • Added support for single-port ConnectX-7 VPI adapter card for DGX A100 System.

  • Support for MLNX_OFED LTS version 23.10-2.1.3.1.

  • Continued support for DGX H100 and DGX H800.

  • The following changes were made to the repositories and the ISO:

    • OS base: 22.04.3 LTS

    • Kernel: 5.15.0-1046-nvidia

    • NVIDIA GPU Driver: 535.161.07

    • CUDA Toolkit: 12.2-1

    • NCCL: 2.20.3

    • cuDNN: 8.9.7

    • DCGM: 3.3.5

    • GPUDirect Storage: 1.7.2

    • NVSM: 23.12.01

    • Docker Engine: 24.0.7-1

    • NVIDIA Container Toolkit: 1.14.6

    • MIG Configuration Tool: 0.5.5

    • NGC CLI: 3.36.0

    • DLFW: 24.01

    • GDRCopy: 2.4.1

DGX OS 6.1.0 (August 11, 2023)#

  • The DGX OS ISO 6.1.0 has been released.

  • The following changes were made to the repositories and the ISO

    • Added support for DGX H800.

    • Kernel update to 5.15.0-1029-nvidia.

    • The gdrcopy packages are removed from ISO but are still available from the repository.

    • The gdrcopy packages can be installed as an option but are no longer installed by default.

    • The dgx-h100-ota-update-meta package is updated to 23.07.1.

    • The nvidia-manage-ofed package is updated to 23.07-1.

    • NVSM is updated to 23.06.2.

    • NVIDIA CUDA Toolkit is updated to 12.2.0.

    • NVIDIA Container Toolkit is updated to 1.13.5.

DGX OS 6.0.11 (May 17, 2023)#

  • Added support for DGX H100

  • The DGX OS ISO 6.0.11 has been released.

  • The following changes were made to the repositories and the ISO

    • Kernel version updated to 5.15.0-1025.25

    • NVSM updated to 22.12.06

DGX OS 6.0.10 (May 3, 2023)#

DGX OS ISO Releases#

This section lists all DGX OS ISO releases with the software versions included in the image.

DGX OS ISO 6.3.1#

Component

Version

Notes

Ubuntu

Ubuntu 22.04.4

Base OS 6.3.1

Ubuntu Kernel

5.15.0-1063-nvidia

GPU Driver

550.90.07

CUDA Toolkit

12.4 Update 1

CUDA Toolkit is only installed by default for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

Inbox OFED

39.0-1

NCCL

2.22.3

cuDNN

9.3.0

DCGM

3.3.8

GPUDirect Storage (GDS)

  • 1.9 for CUDA 12.4

  • 1.7 for CUDA 12.2 Update 2

NVIDIA Container Toolkit

1.16.1-1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.16.1-1

  • libnvidia-container1: 1.16.1-1

  • nvidia-container-toolkit: 1.16.1-1

NVSM

24.06.02

Docker Engine

27.1.2-1

GDRCopy

2.4.1

MIG Configuration Tool

0.9.1-1

Refer to NVIDIA mig-parted github pages and deployments.

DLFW

24.07

ISO

DGXOS-6.3.1-2024-09-06-11-34-41.iso

MD5 Checksum

795ec27bf05da792fc9cd7091475467c

DGX OS ISO 6.3.0#

Component

Version

Notes

Ubuntu

Ubuntu 22.04.4

Base OS 6.3.0

Ubuntu Kernel

5.15.0-1061-nvidia

GPU Driver

CUDA Toolkit

CUDA Toolkit is only installed by default for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

Inbox OFED

39.0-1

NCCL

2.22.3

cuDNN

9.2.1

DCGM

3.3.7

GPUDirect Storage (GDS)

  • 1.9 for CUDA 12.4

  • 1.7.2 for CUDA 12.2 Update 2

  • 1.0 for CUDA 11.4

NVIDIA Container Toolkit

1.16.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.16.1

  • libnvidia-container1: 1.16.1

  • nvidia-container-toolkit: 1.16.1

NVSM

24.06.01

Docker Engine

26.1.4

GDRCopy

2.4.1

MIG Configuration Tool

0.8.0

Refer to NVIDIA mig-parted github pages and deployments.

DLFW (BM)

24.06

ISO

DGXOS-6.3.0-2024-07-31-06-39-06.iso

MD5 Checksum

d0f8cbc8691c217486b38160672da51e

DGX OS ISO 6.2.1#

Component

Version

Notes

Ubuntu

Ubuntu 22.04.4

Base OS 6.2.1

Ubuntu Kernel

5.15.0-1053-nvidia

GPU Driver

535.161.08

CUDA Toolkit

CUDA Toolkit 12.2.2

CUDA Toolkit is only installed by default for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

Inbox OFED

39.0-1

NCCL

2.20.3

cuDNN

8.9.7

DCGM

3.3.5

GPUDirect Storage (GDS)

1.7.2

NVIDIA Container Toolkit

1.14.6-1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.14.6-1

  • libnvidia-container1: 1.14.6-1

  • nvidia-container-toolkit: 1.14.6-1

NVSM

23.12.01

Docker Engine

24.0.7-1

GDRCopy

2.4.1

MIG Configuration Tool

0.5.5

NGC CLI

3.36.0

DLFW (BM)

24.01

ISO

DGXOS-6.2.1-2024-04-22-11-45-46.iso

MD5 Checksum

ece1d02f34e9739f8c5538303b82630f

DGX OS ISO 6.2.0#

Component

Version

Notes

Ubuntu

Ubuntu 22.04.3 LTS

Base OS 6.2.0

Ubuntu Kernel

5.15.0-1046-nvidia

GPU Driver

535.161.07

CUDA Toolkit

CUDA Toolkit 12.2.1

CUDA Toolkit is only installed by default for DGX stations and is optional for DGX servers. Refer to the CUDA Release Notes for driver compatibility information.

Inbox OFED

39.0-1

NCCL

2.20.3

cuDNN

8.9.7

DCGM

3.3.5

GPUDirect Storage (GDS)

1.7.2

NVIDIA Container Toolkit

1.14.6

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.14.6

  • libnvidia-container1: 1.14.6

  • nvidia-container-toolkit: 1.14.6

NVSM

23.12.01

Docker Engine

24.0.7-1

GDRCopy

2.4.1

MIG Configuration Tool

0.5.5

NGC CLI

3.36.0

DLFW (BM)

24.01

ISO

DGXOS-6.2.0-2024-03-15-14-25-26.iso

MD5 Checksum

ecd6c5f77d957d41c8132a0d3941cf8c

DGX OS ISO 6.1.0#

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1029-nvidia

GPU Driver

R535: 535.54.03

CUDA Toolkit

12.2.0

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.18.3

cuDNN

8.9.1

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

23.06.02

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.5

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.5-1

  • libnvidia-container1: 1.13.5-1

  • nvidia-container-toolkit: 1.13.5-1

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.06

ISO

DGXOS-6.1.0-2023-08-09-12-30-10.iso

MD5 Checksum

d38620ffa58905330c1efe49b3d7ff53

DGX OS ISO 6.0.11#

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1025.25

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.06

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.11-2023-05-16-16-18-31.iso

MD5 Checksum

21d73f97b1e8d3efc15eddabb53c4f17

DGX OS ISO 6.0.10#

Component

Version

Additional Information

Ubuntu

22.04 LTS

Optimized Kernel

5.15.0-1023.23

GPU Driver

R525: 525.105.17

CUDA Toolkit

12.0.1

Note

The CUDA Toolkit is only installed for DGX Stations and option for DGX servers. Refer also to the latest CUDA Release Notes for driver compatibility information.

NCCL

2.17.1

cuDNN

8.9.0.131

DCGM

3.1.8

Inbox OFED

39.0-1

GPUDirect Storage (GDS)

2.15.1

NVSM

22.12.04

Docker Engine

23.0.4

Refer to Docker Engine

NVIDIA Container Toolkit

1.13.1

NVIDIA Container Toolkit includes the following packages:

  • libnvidia-container-tools: 1.13.1-1

  • libnvidia-container1: 1.13.1-1

  • nvidia-container-toolkit: 1.13.1-1

  • nvidia-docker2: 2.11.0

MIG Configuration Tool

0.5.1

Refer to the following NVIDIA mig-parted github pages and systemd

NGC CLI

3.17.0

Refer to the NGC CLI Documentation.

DLFW (BM)

23.03

ISO

DGXOS-6.0.10-2023-05-02-19-06-32.iso

MD5 Checksum

55ae2430a4ca490e0383f3740a39941e
On this page