Introduction to NVIDIA DGX B300 Systems#
The NVIDIA DGX™ B300 system is a universal system purpose-built for all AI infrastructure and workloads from analytics to training to inference. The system is built on eight NVIDIA B300 Tensor Core GPUs.
Hardware Overview#
DGX B300 Physical and Operational Specifications#
This section provides the physical specifications to install, power, and operate the system in a data center.
Specification |
Measurement |
|---|---|
Packaged system weight |
|
Package size (H x W x L) |
41.93 x 28 x 46.38 in (1065 x 711 x 1178 mm) |
System weight |
|
System size (H x W x L) |
17.4 x 19 x 35.74 in (442 x 482.6 x 904.2 mm) |
Rack Units |
10 RU |
Acoustic power (LwA,m) |
|
Airflow @70% PWM |
|
Power inlets |
12 (AC only) |
Voltage |
|
Maximum current per outlet |
|
Power consumption |
14.5 kW |
Power supplies |
12 x 3.2 kW |
Heat output (BTUs/hr) |
49,476.054 Max |
Inlet air temperature |
10 °C - 30 °C (50˚F - 86˚F) |
Change in temperature (∆T) |
DGX B300 Feature Summary#
The NVIDIA DGX B300 system includes the following features.
Feature |
Description |
|---|---|
GPU |
8 x NVIDIA B300 Blackwell Ultra GPUs |
GPU memory |
8 x 288 GB = 2.3 TB total |
Performance |
|
NVSwitch |
2 x 5th generation NVIDIA NVLink™ interconnects |
CPUs |
2 x Intel® Xeon® Platinum 6776P processors |
System memory |
2 TB default (up to 4 TB) |
Networking connectivity and speed |
|
Cache storage |
8 x E1.S 3.84 TB NVMe self-encrypting drives |
Boot storage |
2 x 1.92 TB M.2 NVMe (software encryptable) |
Host management |
On-board 10 Gb/s RJ-45 Ethernet |
Remote system management |
|
Operating system |
|
Key Enhancements Over Previous DGX Systems#
The NVIDIA DGX B300 system introduces several key enhancements over previous DGX systems, including:
Available in both AC/PDU and DC/busbar versions.
Features fully redundant power:
N+N power supplies, or
Redundant in-rack power shelves connected to busbar.
All I/O connectivity is moved to the front of the system.
ConnectX-8 networking connects directly to GPUs via PCIe Gen6.
NICs, including cages for connectivity, are housed in the GPU tray.
Power supplies are front-loaded with rear power connections.
All cooling fans are accessible from the rear.
Switched to E1.S cache drives from U.2 while maintaining the same capacity and configuration.
A new, replaceable DC-SCM (Datacenter-ready Secure Control Module) contains the BMC.
Supports up to 4 TB of RAM, configurable on-site with 128 GB DIMMs purchased from NVIDIA.
The motherboard and GPU trays are installed on sliding rails for easy access.
Features a new black front look with a distinguishing gold bezel.
DGX B300 Exploded Views#
These exploded view diagrams depict the system components and their installations within the system. The front of the system provides access to the fans, drives, bezel, front cage, and power distribution board. The back of the system allows access to the GPU tray, motherboard tray, and power supplies.
Exploded View of DGX B300 with AC Power Components#
Exploded View of DGX B300 with DC Power Components#
Power Specifications#
The DGX B300 can be powered in two ways: using a busbar or a traditional data center power distribution unit (PDU) connected to the power supplies.
Busbar version: Includes a clip at the back of the DGX B300 system to connect to a busbar-equipped rack. To energize the busbar, power shelves (not included with the DGX B300) need to be connected to it.
Power supply version: Equipped with 12 power supplies for N+N power redundancy.
Input |
Specification for Each Power Supply |
|
|---|---|---|
200-240 volts AC |
15 kW system max. |
3.3 kW @ 200-240 V, 16 A, 50-60 Hz |
54 Volts DC |
15 kW system max. |
300 A maximum current |
Support for PSU Redundancy and Continuous Operation#
The system includes 12 power supply units (PSU) configured for N+N redundancy, ensuring continuous operation and power reliability.
In an N+N redundancy configuration,
The minimum number of required PSUs is six.
If one PSU fails, troubleshoot the cause and replace the failed PSU immediately.
The system only boots if at least three PSUs are operational. If fewer than three are operational, only the BMC is available.
Do not operate the system with PSUs depopulated.
DGX B300 Locking Power Cord Specification#
The DGX B300 system is shipped with a set of twelve (12) locking power cords that have been qualified for use with the DGX B300 system to ensure regulatory compliance.
Warning
To avoid electric shock or fire, only use the NVIDIA-provided power cords to connect power to the DGX B300. For more information, refer to Electrical Precautions.
Important
Do not use the provided cables with any other product or for any other purpose.
Power Cord Specification
Power Cord Feature |
Specification |
|---|---|
Electrical |
250VAC, 20A |
Plug standard |
C19/C20 |
Dimension |
1200mm length |
Compliance |
Cord: UL62, IEC60227 Connector/Plug: IEC60320-1 |
Using the Locking Power Cords#
This section provides information about how to use the locking power cords.
Locking and Unlocking the PDU Side
Power Distribution Unit side
To INSERT, push the cable into the PDU socket.
To REMOVE, press the clips together and pull the cord out of the socket.
Locking/Unlocking the PSU Side (Cords with Twist-Lock Mechanism)
Power Supply (System) side - Twist locking
To INSERT or REMOVE, ensure the cable is UNLOCKED and push/ pull into/out of the socket.
Front Panel Connections and Controls#
This section provides information about the front panel, connections, and controls of the DGX B300 system.
With a Bezel#
This is an image of the DGX B300 system with a bezel.
Control |
Description |
|---|---|
Power button |
Press to turn the DGX B300 system on or off.
|
ID button |
Press to activate the blue LED for identification during servicing. The LED can be configured to turn on or blink via the BMC. It also causes an LED on the back of the unit to flash as an identifier during servicing. |
Fault LED |
Amber on: System or component fault detected. |
Without a Bezel#
The following images show the front views without the bezel of the DGX B300 system.
Front View of DGX B300 with AC Power Supplies#
Front View of DGX B300 (DC)#
Important
Refer to the section First Boot Setup for instructions on how to properly turn the system on or off.
Rear Panel Modules#
The following images show the rear views including the AC power inlets and the DC power bus bar clip of the DGX B300 system.
Rear View of DGX B300 with AC Power Inlets#
Rear View of DGX B300 with DC Bus Bar Clip#
Motherboard Connections and Controls#
The following image shows the motherboard connections and controls in a DGX B300 system.
Control |
Description |
|---|---|
Power button |
Press to turn the system on or off. |
UID (Unit identification) and LED |
It blinks when the UID button is pressed from the front of the unit to help identify the unit that needs servicing. |
BMC reset button |
Press to manually reset the BMC. |
See Network Connections, Cables, and Adapters for details on the network connections.
Motherboard Tray Components#
The following image shows the motherboard tray components in the DGX B300 system.
GPU Tray Components#
The following image shows the GPU tray components in the DGX B300 system.
Side View of DGX B300 GPU Tray#
Top View of DGX B300 GPU Tray#
Network Connections, Cables, and Adapters#
This section provides information about network connections, cables, and adapters.
DGX B300 Port Description#
This image shows the eight network ports located on the DGX B300 GPU tray.
This image shows the network ports on the DGX B300 system motherboard.
Port Designation |
||||
|---|---|---|---|---|
Port |
PCI Bus |
Default |
Optional |
RDMA |
OSFP1 |
ed:00.0 |
ibp237s0 |
enp237s0np0 |
mlx5_15 |
OSFP2 |
97:00.0 |
ibp151s0 |
enp151s0np0 |
mlx5_10 |
OSFP3 |
dc:00.0 |
ibp220s0 |
enp220s0np0 |
mlx5_14 |
OSFP4 |
b9:00.0 |
ibp185s0 |
enp185s0np0 |
mlx5_11 |
OSFP5 |
17:00.0 |
ibp23s0 |
enp23s0np0 |
mlx5_0 |
OSFP6 |
70:00.0 |
ibp112s0 |
enp112s0np0 |
mlx5_9 |
OSFP7 |
39:00.0 |
ibp57s0 |
enp57s0np0 |
mlx5_5 |
OSFP8 |
5f:00.0 |
ibp95s0 |
enp95s0np0 |
mlx5_8 |
Slot 1 Port 1 |
cc:00.0 |
ibp204s0f0 |
enp204s0f0np0 |
mlx5_12 |
Slot 1 Port 2 |
cc:00.1 |
enp204s0f1np1 |
ibp204s0f1 |
mlx5_13 |
Slot 2 Port 1 |
53:00.0 |
ibp83s0f0 |
enp83s0f0np0 |
mlx5_6 |
Slot 2 Port 2 |
53:00.1 |
enp83s0f1np1 |
ibp83s0f1 |
mlx5_7 |
On-board |
2a:00.0 |
eno1 |
N/A |
N/A |
BMC Port LEDs#
The BCM RJ-45 port has two LEDs.
The LED on the left indicates the speed. Solid green indicates the speed is 100M. Solid amber indicates the speed is 1G.
The LED on the right is green and flashes to indicate activity.
Supported Network Cables and Adapters#
The DGX B300 system is not shipped with network cables or adapters. You will need to purchase supported cables or adapters for your network.
The ConnectX-8 firmware determines which cables and adapters are supported. For a list of cables and adapters compatible with the NVIDIA ConnectX cards installed in the DGX B300 system,
Visit the NVIDIA Adapter Firmware Release page.
Click the ConnectX model and select the corresponding firmware included in the DGX B300 system.
From the left Topics pane, select the Validated and Supported Cables and Switches topic.
To configure the BlueField-3 DPU in NIC mode, follow the instructions in NIC Mode for BlueField-3.
DGX B300 System Topology#
The following figure shows the DGX B300 system topology.
DGX OS Software#
The DGX B300 system comes pre-installed with a DGX software stack incorporating the following components:
An Ubuntu server distribution using the optimized Linux kernel with supporting packages
The following system management and monitoring software:
NVIDIA System Management (NVSM)
Provides active health monitoring and system alerts for NVIDIA DGX nodes in a data center. It also provides simple commands for checking the health of the DGX B300 system from the command line.
Data Center GPU Management (DCGM)
This software enables node-wide administration of GPUs and can be used for cluster and data-center level management.
DGX B300 system support packages
The NVIDIA GPU driver, including NVIDIA CUDA
Docker Engine
NVIDIA Container Toolkit
NVIDIA Networking OpenFabrics Enterprise Distribution for Linux (DOCA-OFED)
NVIDIA Networking Software Tools (MST)
cachefilesd (daemon for managing cache data storage)
Customer Support#
Contact NVIDIA Enterprise Support for assistance in reporting, troubleshooting, or diagnosing problems with your DGX B300 system. You can also contact NVIDIA Enterprise Support for help in moving the DGX B300 system.
For contracted Enterprise Support questions, you can send an email to enterprisesupport@nvidia.com.
For more information on obtaining support, go to NVIDIA Enterprise Support.
Our support team can help collect appropriate information about your issue and involve internal resources as needed.