NVIDIA DGX H100/H200 System User Guide

The NVIDIA DGX H100/H200 System User Guide is also available as a PDF.

• Introduction to NVIDIA DGX H100/H200 Systems
  • Hardware Overview
    • DGX H100/H200 Component Descriptions
    • Mechanical Specifications
    • Power Specifications
      • Support for PSU Redundancy and Continuous Operation
    • DGX H100/H200 Locking Power Cord Specification
    • Using the Locking Power Cords
    • Environmental Specifications
    • Front Panel Connections and Controls
      • With a Bezel
      • With the Bezel Removed
    • Rear Panel Modules
    • Motherboard Connections and Controls
    • Motherboard Tray Components
    • GPU Tray Components
  • Network Connections, Cables, and Adaptors
    • Network Ports
    • Compute and Storage Networking
    • Network Modules
    • BMC Port LEDs
    • Supported Network Cables and Adaptors
  • DGX H100/200 System Topology
  • DGX OS Software
  • Customer Support
• Connecting to DGX H100/H200
  • Connecting to the Console
    • Direct Connection
    • Remote Connection through the BMC
  • SSH Connection to the OS
• First Boot Setup
  • System Setup
  • Post Setup Tasks
    • Obtaining Software Updates
    • Enabling the SRP Daemon
• Quickstart and Basic Operation
  • Installation and Configuration
  • Registration
  • Obtaining an NGC Account
  • Turning DGX H100/H200 On and Off
    • Startup Considerations
    • Shutdown Considerations
  • Verifying Functionality - Quick Health Check
  • Running the Pre-flight Test
  • Running NGC Containers with GPU Support
    • Using Native GPU Support
    • Using the NVIDIA Container Runtime for Docker
  • Managing CPU Mitigations
    • Determining the CPU Mitigation State of the DGX System
    • Disabling CPU Mitigations
    • Re-enabling CPU Mitigations
• SBIOS Settings
  • Accessing the SBIOS Setup
  • Configuring the Boot Order
  • Configuring the Local Terminal
    • Linux
    • Windows and MacOS
  • Power on or Reboot the System
• Using the BMC
  • Connecting to the BMC
  • Overview of BMC Controls
  • Open Ports
  • Configuring a Static IP Address for the BMC
    • Configuring a BMC Static Address by Using ipmitool
    • Configuring a BMC Static IP Address by Using the System BIOS
  • Changing the BMC Login Credentials
    • User Name and Password Requirements
    • Procedure
  • Using the Remote Console
  • Setting Up Active Directory, LDAP, or E-Directory
  • Configuring Platform Event Filters
  • Uploading or Generating SSL Certificates
    • Viewing the SSL Certificate
    • Generating the SSL Certificate
    • Uploading the SSL Certificate
    • Updating the SBIOS Certificate
• Managing Power Capping
  • Managing N+N Configuration (IPMI)
  • Managing Power Capping Using Redfish API
• Security
  • User Security Measures
    • Securing the BMC Port
  • System Security Measures
    • Secure Flash of DGX H100/H200 Firmware
    • Encryption
    • NVIDIA System Manager Security
  • Secure Data Deletion
    • Prerequisites
    • Procedure
• Redfish APIs Support
  • Supported Redfish Features
  • Connectivity Between the Host and BMC
  • Redfish Examples
    • BMC Manager
    • Firmware Update
    • BIOS Settings
    • Modifying the Boot Order on DGX H100/H200 Using Redfish
    • Telemetry
    • Chassis
    • SEL Logs
    • Virtual Image
    • Collect BMC Debug Data
    • Clear BIOS and Reset to Factory Defaults
    • Querying GPU Power Limit
    • Power Capping
      • Services
      • Domains
      • Custom Policies
      • PSU Policies
• Safety
  • Safety Information
  • Safety Warnings and Cautions
  • Intended Application Uses
  • Site Selection
  • Equipment Handling Practices
  • Electrical Precautions
    • Power and Electrical Warnings
    • Power Cord Warnings
  • System Access Warnings
  • Rack Mount Warnings
  • Electrostatic Discharge
  • Other Hazards
    • CALIFORNIA DEPARTMENT OF TOXIC SUBSTANCES CONTROL
    • NICKEL
    • Battery Replacement
    • Cooling and Airflow

Legal Information

• Compliance
  • United States
  • United States/Canada
  • Canada
  • CE
  • Australia and New Zealand
  • Brazil
  • Japan
  • South Korea
  • China
  • Taiwan
  • Russia/Kazakhstan/Belarus
  • Israel
  • India
  • South Africa
  • Great Britain (England, Wales, and Scotland)
• Third-Party License Notices
  • Micron msecli
  • Mellanox (OFED)
• Notices
  • Notice
  • Trademarks