DGX-1 Version 23.04.1

The DGX-1 Firmware Update container version 23.04.1 is available.

  • Package name: nvfw-dgx1_23.4.1_230411.tar.gz

  • Image name: nvfw-dgx1_23.4.1_230411

  • Run file name: nvfw-dgx1_23.4.1_230411.run

This release is supported with the following DGX OS software.

This container includes the firmware binaries and update utilities for the firmware listed in the following table.

Component

Version

Key Changes

BMC

3.39.30

New update

SBIOS

S2W_3A13

New update

SSD (Samsung SM863A) 1.92 TB

GXM1103Q

No change from previous release

SSD (Samsung PM883) 1.92 TB

HXT7904Q

No change from previous release

SSD (Samsung SM883) 480 GB

HXM7904Q

No change from previous release

VBIOS (DGX-1 with V100, 16 GB)

88.00.18.00.01

No change from previous release

VBIOS (DGX-1 with V100, 32 GB)

88.00.80.00.04

No change from previous release

VBIOS (DGX-1 with P100)

86.00.41.00.05

No change from previous release

PSU

00.03.07

No change from previous release

Special Notes

Note

If updating the BMC from any version earlier than 3.27.30, the update can take from 30 to 50 minutes to complete.

  • When updates to the BMC or PSU are initiated, - The BMC is (cold) reset to be put in a known good state before the update, then - Additional logs are gathered for troubleshooting purposes and made available in /var/log/comp_fw_log.txt

The logs are gathered before updating and upon completion of the update or in the event of an update failure.

  • (On DGX systems installed with DGX OS 4.99.x or earlier): To prevent NVSM services from interfering with BMC and PSU updates, the container stops the following services before applying the update:

    • nvsm-apis-gpumonitor`

    • nvsm-apis-plugin-storage

    • nvsm-apis-selwatcher

    • nvsm-apis-plugin-memory

    • nvsm-apis-plugin-environment

    • nvsm-sys-dshmnvsm-env-dshm

    • nvsm-storage-dshm

  • System health monitor will not be available until firmware update completes.

  • For the PSU update, the container implements a protective check which requires the system to be fully redundant (all four supplies are installed and in a healthy state) in order for the update to occur.

    If you are using only three of the four PSUs, the full power redundancy requirement can be overridden with the Docker run environment (DGX_MAX_PSU) as follows.

Copy
Copied!
            

docker run -e DGX_MAX_PSU=3 --privileged -ti -v /:/hostfs <container_name> update_fw

Note

For container versions 21.06.8 and earlier, running in dockerless mode requires a Python 2 installation on the system. For versions 23.4.1 and later, dockerless mode requires Python 3.

Before updating the BMC using the Web UI, refer to the following instructions to ensure the updates are successful.

BMC Updates via the Web UI

When Preserving Settings

  1. Navigate to Maintenance > Firmware Update, select IPMI, Network, and SEL, then proceed with updating the BMC.

  2. After updating the BMC, issue the following from the command line.

    Copy
    Copied!
                

    sudo ipmitool raw 0x32 0x6 1 sudo ipmitool mc reset cold

Note

You cannot preserve user settings when downgrading to a previous version of the BMC. Attempting to do so will result in a failure to log in to the BMC.

When Not Preserving Settings

Navigate to Maintenance | Firmware Update:

  • clear all preservation items

  • proceed with updating the BMC

Unable to update VBIOS

Issue

System is unable to update VBIOS where the DGX framework update service `nvidia-dcgm.service` will not stop. This is observed when using the latest Base OS with an older FWUC for VBIOS.

Workaround

First, stop the nvidia-dcgm.service then run VBIOS update via FWUC 21.06.8

© Copyright 2022-2023, NVIDIA. Last updated on Apr 19, 2023.