Major Components#

Major components for the DGX SuperPOD configuration are listed in Table 7. These are representative of the configuration and must be finalized based on actual design.

Table 7 Major components of the 4 SU, 256-node DGX SuperPOD#

Count

Component

Recommended Model

DGX Compute and Racks

256

DGX B300 DC Busbar Appliances

DGXB300-DC

72

19” MGX rack with bubar

754-24972-0046-001

8

19” MGX rack without busbar

754-24972-0047-001

160

rPDU for MGX rack

PX4-57A7I2U-C8E7V2

288

33KW power shelf for 19” MGX rack with busbar

755-0129-000

1696

Blank panel

7B32C0800-600-G

7

DC Busbar X86 Control Nodes for Mission Control

SYS-221GE-FNB-A-NC24B

Storage

1

Home storage

AFF A90A

32

DDN AI400 X3 Chassis

32

100GbE Ports

128

400GbE

130

1GbE OOB Ports

2

1GbE Ports in In-band

Compute Fabric

64

SP4 (SN5600) - Compute Leafs - DC

920-9N42F-00RI-KC0

32

SP4 (SN5600) - Compute Spines - DC

920-9N42F-00RI-KC0

2048

Transceivers on DGX

980-9I51A-00NS00

2048

Twin port OSFP Transceivers on Leaf <-> DGX

980-9I510-F4NS00

4096

Twin port OSFP Transceivers on Leaf <-> Spine

980-9I510-F4NS00

4096

DGX-Leaf Cable

980-9I570-00N030

4096

Leaf-Spine Cable

980-9I570-00N030

Ethernet Storage Fabric

8

SP4 (SN5600) - Storage Leafs DGX Side - DC

920-9N42F-00RI-KC0

2

SP4 (SN5600) - Storage Leafs Storage Side - DC

920-9N42F-00RI-KC0

4

SP4 (SN5600) - Storage Spines - DC

920-9N42F-00RI-KC0

512

400G Transceiver (for BF3240)

980-9I693-F4NS00

128

400G Transceiver (for DDN)

980-9I693-F4NS00

4

400G Transceiver (for Control Plane Nodes)

980-9I693-F4NS00

289

Twin port OSFP Transceivers on Leaf <-> DGX/DDN/Mgmt

980-9I510-F4NS00

576

Twin port OSFP Transceivers on Leaf <-> Spine

980-9I510-F4NS00

512

DGX-Leaf Cable

980-9I570-00N030

128

DDN, Mgmt - Leaf Cable

980-9I557-00N030

576

Leaf-Spine Cable

980-9I570-00N030

InfiniBand Storage Fabric

16

NDR Switches, Stroage Leaf DGX Side

920-9B210-00RN-0M6

4

NDR Switches, Stroage Leaf Storage Side

920-9B210-00RN-0M6

8

NDR Switches, storage spines

920-9B210-00RN-0M6

512

400G Transceiver (for BF3240)

980-9I693-00NS00

128

400G Transceiver (for DDN)

980-9I693-00NS00

8

400G Transceiver (for Control Plane Nodes and UFM)

980-9I51S-00NS00

324

Twin port OSFP Transceivers on Leaf <-> DGX/DDN/Mgmt

980-9I510-00NS00

512

Twin port OSFP Transceivers on Leaf <-> Spine

980-9I510-00NS00

2

UFM Appliance

920-9B020-00RA-0D0

2

UFM <-> Inband Transceiver

980-9I693-F4NS00

648

Leaf Cable

980-9I570-00N030

512

Leaf-Spine Cable

980-9I570-00N030

Inband Fabric

4

SP4 (SN5600) - Inband Leafs

920-9N42F-00RI-KC0

2

SP4 (SN5600) - Inband Spines

920-9N42F-00RI-KC0

512

400G Transceiver (for BF3240)

980-9I693-F4NS00

24

400G Transceiver (for Control Plane Nodes)

980-9I51S-F4NS00

134

Twin port OSFP Transceivers on Leaf <-> DGX, Management

980-9I510-F4NS00

32

Twin port OSFP Transceivers on Leaf <-> Spine

980-9I510-F4NS00

269

DGX, Mgmt - Leaf Cable

980-9I557-00N030

32

Leaf-Spine Cable

980-9I570-00N030

10

800G Transceivers (between leaf -> NFS & Uplink)

980-9I30H-F4NM00

20

DR4 -> 4x DR1 Fabric Splitter Leaf->NFS, SN2201, Uplink

NV08M31P2X1BHM020

4

100G DR1 (Uplink, NFS -> SP4)

32

DR1 Storage

980-9I042-00C000

2

Inband <-> DDN Inband, using 25GbE port on SN5600, QSA 1/10G

980-9I71G-00J000

2

Inband <-> DDN Inband, using 25GbE port on SN5600, BaseT RJ45

980-9I251-00IS00

Out of Band Management

33

SN2201

920-9N110-00R1-0C0

33

SN2201

920-9N110-00R1-NC0

15 38

Total RJ45 Count

Cat6

66

100G DR1 Transceiver (SN2201 @OOB )

980-9I042-00C000

18

800G optics (SN5600 Inband Spines -> SN2201)

980-9I30H-F4NM00