Simultaneously Updating the Firmware for Separate Rack Trays#
With nvfwupd v2.0.5 and later, seperate server rack trays can be updated simultaneously.
Note
Due to BMC memory limitations, the BMC and Compute tray cannot be updated simultaneously.
Updating the GB200 NVL BMC Tray with the GB200 NVL Switch#
To simultaneously update the firmware for a GB200 NVL BMC tray and GB200 NVL Switch:
Create a nvfwupd configuration yaml file that contains
"ParallelUpdate": true.Create a list of Targets, one target for each tray of the rack, each of which contains
BMC_IP,RF_USERNAME,RF_PASSWORD, andPACKAGEas mandatory parameters.For platforms that require
servertype, includeTARGET_PLATFORM.Include
UPDATE_PARAMETERS_TARGETSfor each tray of the rack that requires a special json file to update.
Here is an example of a configuration file for rack server parallel update of the BMC and Switch trays:
$ cat bmc_switch_parallel_update_config.yaml
# To enable parallel update in nvfwupd, set the ParallelUpdate key to true
ParallelUpdate: true
# When ParallelUpdate is enabled, "Targets" becomes a list of systems alongside their packages
# BMC_IP, RF_USERNAME, RF_PASSWORD, PACKAGE are mandatory when using parallel update
# TARGET_PLATFORM would be needed for any systems that would normally require it from the command line (i.e: GB200, gb200switch, etc.)
# UPDATE_PARAMETERS_TARGETS is optional, but uses the same exact params as the special target file for nvfwupd "-s" option in json format with a given system
# SYSTEM_NAME is an entirely optional, but recommended user defined string. It is used to more easily distinguish systems as it is used in task printouts
Targets:
- BMC_IP: "3.3.3.3"
RF_USERNAME: "****"
RF_PASSWORD: "****"
TARGET_PLATFORM: 'gb200switch'
PACKAGE: "nvfw_GB200-P4978_0004_241209.1.7_dbg-signed.fwpkg"
- BMC_IP: "5.5.5.5"
RF_USERNAME: "****"
RF_PASSWORD: "****"
TARGET_PLATFORM: 'GB200'
PACKAGE: "nvfw_GB200-P4972_0004_240808.1.1_custom_prod-signed.fwpkg"
UPDATE_PARAMETERS_TARGETS: {"Targets": [], "ForceUpdate": true}
Now the
show_versioncommand can be used to show the BMC and Switch tray versions in parallel:
$ nvfwupd -c bmc_switch_parallel_update_config.yaml show_version
System Model: N5200_LD
Part number: 692-96099-00MV-JS0
Serial number: MT2446600UNE
Packages: ['GB200-P4978_0004_241209.1.7']
Connection Status: Successful
Firmware Devices:
AP Name Sys Version Pkg Version Up-To-Date
------- ----------- ----------- ----------
ASIC 35.2014.1610 N/A No
BIOS 0ACTV_00.01.010d N/A No
BMC 88.0002.0600 88.0002.0600 Yes
CPLD1 CPLD000370_REV0300 N/A No
CPLD2 CPLD000377_REV0500 N/A No
CPLD3 CPLD000373_REV0205 N/A No
CPLD4 CPLD000390_REV0200 N/A No
EROT 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-ASIC1 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-ASIC2 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-BMC 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-CPU 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-FPGA 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
FPGA 0.1A 0.19 Yes
SSD CE00A400 N/A No
transceiver N/A N/A No
------------------------------------------------------------------------------------------------------------------------
System Model: GB200 NVL
Part number: $TRAY_PART_NUMBER
Serial number: $TRAY_SERIAL_NUMBER
Packages: ['GB200-P4972_0004_240808.1.1_custom']
Connection Status: Successful
Firmware Devices:
AP Name Sys Version Pkg Version Up-To-Date
------- ----------- ----------- ---------
FW_BMC_0 gb200nvl-24.08-2 GB200Nvl-24.08-2 Yes
FW_CPLD_0 0.00 N/A No
FW_CPLD_1 0.00 N/A No
FW_CPLD_2 0.00 N/A No
FW_CPLD_3 0.00 N/A No
FW_ERoT_BMC_0 01.03.0183.0000_n04 01.03.0183.0000_n04 Yes
NIC_0 28.98.9122 N/A No
UEFI buildbrain-gcid-37009178 N/A No
HGX_FW_BMC_0 gb200nvl-24.08-2 N/A No
HGX_FW_CPLD_0 0.112 N/A No
HGX_FW_CPU_0 02.02.02 N/A No
HGX_FW_CPU_1 02.02.02 N/A No
HGX_FW_ERoT_BMC_0 01.03.0183.0000_n04 N/A No
HGX_FW_ERoT_CPU_0 01.03.0183.0000_n04 N/A No
HGX_FW_ERoT_CPU_1 01.03.0183.0000_n04 N/A No
HGX_FW_ERoT_FPGA_0 01.03.0183.0000_n04 N/A No
HGX_FW_ERoT_FPGA_1 01.03.0183.0000_n04 N/A No
HGX_FW_FPGA_0 312e3041 N/A No
HGX_FW_FPGA_1 312e3041 N/A No
HGX_FW_GPU_0 97.00.0c.00.00 N/A No
HGX_FW_GPU_1 97.00.0c.00.00 N/A No
HGX_FW_GPU_2 97.00.0c.00.00 N/A No
HGX_FW_GPU_3 97.00.0c.00.00 N/A No
HGX_InfoROM_GPU_0 g548.0201.01.02 N/A No
HGX_InfoROM_GPU_1 g548.0201.01.02 N/A No
HGX_InfoROM_GPU_2 g548.0201.01.02 N/A No
HGX_InfoROM_GPU_3 g548.0201.01.02 N/A No
------------------------------------------------------------------------------------------------------------------------
Error Code: 0
After viewing the BMC and Switch tray package versions in parallel, the update can be started using the
update_fwcommand.
$ nvfwupd -c bmc_switch_parallel_update_config.yaml update_fw
After the firmware updates are complete, to activate the firmware, four
activate_fwcommands will be necessary.
Here are the commands for the BMC tray:
$ nvfwupd -t ip=<BMC IP> user=**** password=**** servertype=GB200 activate_fw -c PWR_OFF
IPMI Command Status: Success
Chassis Power Control: Down/Off
-------------------------------------------------------------------------------------------
$ nvfwupd -t ip=<BMC IP> user=**** password=**** servertype=GB200 activate_fw –c RF_AUX_PWR_CYCLE
AUX Power Cycle requested successfully.
Server response:
""
-------------------------------------------------------------------------------------------
After you run the commands in step 5, the system will reboot.
After the system is reachable again, use the Power On command to enable everything.
$ nvfwupd -t ip=<BMC IP> user=**** password=**** activate_fw -c PWR_ON
IPMI Command Status: Success
Chassis Power Control: Up/On
-------------------------------------------------------------------------------------------
The switch tray can be activated using the following command:
$ nvfwupd -t ip=<NVOS IP> user=*** password=*** servertype=gb200switch activate_fw -c NVUE_PWR_CYCLE
Power cycle task was created with ID 11
Status for Job Id 11:
{'detail': '',
'http_status': 200,
'issue': [],
'percentage': '',
'state': 'running',
'status': '',
'timeout': 5,
'type': ''}
Updating the GB200 NVL Compute Tray with the GB200 NVL Switch#
To simultaneously update the firmware for a GB200 NVL Compute tray and GB200 NVL Switch:
Create a nvfwupd configuration yaml file that contains
"ParallelUpdate": true.Create a list of Targets, one target for each tray of the rack, each of which contains
BMC_IP,RF_USERNAME,RF_PASSWORD, andPACKAGEas mandatory parameters.For platforms that require
servertype, includeTARGET_PLATFORM.Include
UPDATE_PARAMETERS_TARGETSfor each tray of the rack that requires a special json file to update.
Here is an example of a configuration file for rack server parallel update of the Compute and Switch trays:
$ cat compute_switch_update_config.yaml
# To enable parallel update in nvfwupd, set the ParallelUpdate key to true
ParallelUpdate: true
# When ParallelUpdate is enabled, "Targets" becomes a list of systems alongside their packages
# BMC_IP, RF_USERNAME, RF_PASSWORD, PACKAGE are mandatory when using parallel update
# TARGET_PLATFORM would be needed for any systems that would normally require it from the command line (i.e: GB200, gb200switch, etc.)
# UPDATE_PARAMETERS_TARGETS is optional, but uses the same exact params as the special target file for nvfwupd "-s" option in json format with a given system
# SYSTEM_NAME is an entirely optional, but recommended user defined string. It is used to more easily distinguish systems as it is used in task printouts
Targets:
- BMC_IP: "3.3.3.3"
RF_USERNAME: "****"
RF_PASSWORD: "****"
TARGET_PLATFORM: 'gb200switch'
PACKAGE: "nvfw_GB200-P4978_0004_241209.1.7_dbg-signed.fwpkg"
- BMC_IP: "4.4.4.4"
RF_USERNAME: "****"
RF_PASSWORD: "****"
SYSTEM_NAME: "HMC"
TARGET_PLATFORM: 'GB200'
PACKAGE: "nvfw_GB200-P4975_0004_240808.1.0_custom_prod-signed.fwpkg"
UPDATE_PARAMETERS_TARGETS: {"Targets": ["/redfish/v1/Chassis/HGX_Chassis_0"]}
Now the
show_versioncommand can be used to show the Compute and Switch tray versions in parallel:
$ nvfwupd -c compute_switch_update_config.yaml show_version
System Model: N5200_LD
Part number: 692-96099-00MV-JS0
Serial number: MT2446600UNE
Packages: ['GB200-P4978_0004_241209.1.7']
Connection Status: Successful
Firmware Devices:
AP Name Sys Version Pkg Version Up-To-Date
------- ----------- ----------- ----------
ASIC 35.2014.1610 N/A No
BIOS 0ACTV_00.01.010d N/A No
BMC 88.0002.0600 88.0002.0600 Yes
CPLD1 CPLD000370_REV0300 N/A No
CPLD2 CPLD000377_REV0500 N/A No
CPLD3 CPLD000373_REV0205 N/A No
CPLD4 CPLD000390_REV0200 N/A No
EROT 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-ASIC1 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-ASIC2 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-BMC 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-CPU 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
EROT-FPGA 01.04.0000.0000_n04 01.03.0235.0000_n04 Yes
FPGA 0.1A 0.19 Yes
SSD CE00A400 N/A No
transceiver N/A N/A No
------------------------------------------------------------------------------------------------------------------------
System Model: GB200 NVL
Part number: $TRAY_PART_NUMBER
Serial number: $TRAY_SERIAL_NUMBER
Packages: ['GB200-P4975_0004_240808.1.0_custom']
Connection Status: Successful
Firmware Devices:
AP Name Sys Version Pkg Version Up-To-Date
------- ----------- ----------- ---------
FW_BMC_0 gb200nvl-24.08-2 N/A No
FW_CPLD_0 0.00 N/A No
FW_CPLD_1 0.00 N/A No
FW_CPLD_2 0.00 N/A No
FW_CPLD_3 0.00 N/A No
FW_ERoT_BMC_0 01.03.0183.0000_n04 N/A No
NIC_0 28.98.9122 N/A No
UEFI buildbrain-gcid-37009178 N/A No
HGX_FW_BMC_0 gb200nvl-24.08-2 GB200Nvl-24.08-2 Yes
HGX_FW_CPLD_0 0.112 0.1C Yes
HGX_FW_CPU_0 02.02.02 02.02.02 Yes
HGX_FW_CPU_1 02.02.02 02.02.02 Yes
HGX_FW_ERoT_BMC_0 01.03.0183.0000_n04 01.03.0183.0000_n04 Yes
HGX_FW_ERoT_CPU_0 01.03.0183.0000_n04 01.03.0183.0000_n04 Yes
HGX_FW_ERoT_CPU_1 01.03.0183.0000_n04 01.03.0183.0000_n04 Yes
HGX_FW_ERoT_FPGA_0 01.03.0183.0000_n04 01.03.0183.0000_n04 Yes
HGX_FW_ERoT_FPGA_1 01.03.0183.0000_n04 01.03.0183.0000_n04 Yes
HGX_FW_FPGA_0 312e3041 1.0A Yes
HGX_FW_FPGA_1 312e3041 1.0A Yes
HGX_FW_GPU_0 97.00.0c.00.00 97.00.0D.00.00 No
HGX_FW_GPU_1 97.00.0c.00.00 97.00.0D.00.00 No
HGX_FW_GPU_2 97.00.0c.00.00 97.00.0D.00.00 No
HGX_FW_GPU_3 97.00.0c.00.00 97.00.0D.00.00 No
HGX_InfoROM_GPU_0 g548.0201.01.02 N/A No
HGX_InfoROM_GPU_1 g548.0201.01.02 N/A No
HGX_InfoROM_GPU_2 g548.0201.01.02 N/A No
HGX_InfoROM_GPU_3 g548.0201.01.02 N/A No
------------------------------------------------------------------------------------------------------------------------
Error Code: 0
After viewing the Compute and Switch tray package versions in parallel, the update can be started using the
update_fwcommand.
$ nvfwupd -c compute_switch_update_config.yaml update_fw
After the firmware updates are complete, to activate the firmware, four
activate_fwcommands will be necessary.
Here are the commands for the compute tray:
$ nvfwupd -t ip=<BMC IP> user=**** password=**** servertype=GB200 activate_fw -c PWR_OFF
IPMI Command Status: Success
Chassis Power Control: Down/Off
-------------------------------------------------------------------------------------------
$ nvfwupd -t ip=<BMC IP> user=**** password=**** servertype=GB200 activate_fw –c RF_AUX_PWR_CYCLE
AUX Power Cycle requested successfully.
Server response:
""
-------------------------------------------------------------------------------------------
After you run the commands in step 5, the system will reboot.
After the system is reachable again, use the Power On command to enable everything.
$ nvfwupd -t ip=<BMC IP> user=**** password=**** activate_fw -c PWR_ON
IPMI Command Status: Success
Chassis Power Control: Up/On
-------------------------------------------------------------------------------------------
The switch tray can be activated using using the following command:
$ nvfwupd -t ip=<NVOS IP> user=*** password=*** servertype=gb200switch activate_fw -c NVUE_PWR_CYCLE
Power cycle task was created with ID 11
Status for Job Id 11:
{'detail': '',
'http_status': 200,
'issue': [],
'percentage': '',
'state': 'running',
'status': '',
'timeout': 5,
'type': ''}