NVIDIA DGX SuperPOD: Cabling Data Centers Design Guide

Document Number	DU-10438-001 V04
Publication Date	2023-03-31

Tip

The NVIDIA DGX SuperPOD: Cabling Data Centers Design Guide is also available as a PDF.

Cabling Data Centers Design Guide

• Introduction
  • Target Audience
  • Document Conventions
  • Warnings

InfiniBand Cables Primer

• InfiniBand Cables Primer Overview
• Mixing Widths and Rates
• Cable Latency
• Connectors
• Breakout Cables
• Port Power
• Cable Technologies
  • Copper
    • Passive Copper
    • Active Copper
  • Optical Fiber
    • Active Optical Cables
    • Optical Transceivers with Passive Fiber
      • MMA1T00-HS Optical Transceiver
      • MMS1W50-HM optical transceiver

NDR InfiniBand

• NDR Overview
• Components
  • NDR Switch Connectors (OSFP)
  • NDR Cable Connectors
  • NDR Optical Transceivers
  • NDR MPO/APC Fiber
  • Minimum Bend Radius for NDR Cables
• Connecting NDR Components Together
  • NDR Copper Connectivity
  • NDR Switch-to-Switch Fiber Connectivity
  • NDR Switch-to-Endpoint Fiber Connectivity
  • NDR Connections to HDR and EDR
• Maintaining NDR Connectors and Cables

Ethernet Cables Primer

• Ethernet Cables Primer Overview
• Commonalities with InfiniBand
• Additional Cable Latency
  • SFP Connectors
  • 1G BASE-T Connectivity
• Ethernet Switch Ports
  • Mixing Port Speeds
  • Splitting Switch Ports
  • Splitter Cables
  • Connecting SFP to QSFP
  • Quad to Single Adapters (QSAs)
  • Ethernet Transceivers
• Short Reach (SR) Transceivers

Cable Deployment Planning

• Considerations
  • Physical Cable Routes
  • Selecting Cables
  • Selecting Racks
  • Selecting Cable Management
• Document Network Connectivity
  • Point-to-Point Cable Map
  • Constructing Cable BOM
  • Labeling Information

Cable Deployment Methodology

• Assess the Environment
• Survey Cable Management
• Inventory
• Stage
  • Un-Boxing and Un-Bagging
  • Labeling and Grouping
  • Unrolling and Bundling
    • Unrolling
    • Bundling
• Deploying the Bundles
  • Install
    • Installing the inter-rack cable bundles
  • Connecting and Dressing Cables/Bundles
    • Connecting
    • Dressing for Equipment
• Cable Management
• In-Rack Cable Management
• Cable Management Requirements
• Cable Management Best Practices
• Poor Cable Management

Cable Support Systems

• Planning Considerations
• Cable Support Mounting
• Cable Support Load Distribution
• Span Load Examples
• Trapeze Layers
  • Trapeze Single Layer
  • Trapeze Dual Layer
• Cable Management Guidance

Appendix A

• Terms and Definitions

Appendix B

• Building Cable Standards
• Cable Tray Standards

Notices

• Notices
  • Notice
  • Trademarks
  • Copyright