NVIDIA Mission Control DGX SuperPOD Ethernet North-South Network Configuration Guide

Guide map

Use the following quick links to navigate each section of this guide:

• Introduction - Scope, assumptions, and baseline context for GB200/GB300 North-South network deployment.

• Networking Planning and Design - Logical design, subnet allocations, and edge handoff patterns.

• Network Provisioning Workflow - Two-stage automation workflow, required inputs, and generated outputs.

• Input File Format Requirements (Manifest) - Required schemas and format rules for SiteInfo, P2P, and inventory files.

• Pre-Network Bringup - Pre-run checklist and readiness gates before onsite fabric bringup.

• BCM Bootstrap Workflow - Ordered BCM bootstrap actions, checkpoints, and expected artifacts.

• NVLink Switch Bringup Workflow - NVLink switch connectivity, bootstrap sequence, and verification flow.

• Network Validation for North-South Network - Post-bringup underlay/overlay, health, and reachability validation checks.

• Glossary of Terms - Definitions for key terminology used throughout this guide.

Contents:

• Introduction
  • Reference Documentation
  • Downloads
  • Physical Hardware
• Networking Planning and Design
  • Logical Network Design
  • Ethernet Networking (North-to-South)
    • Data and OOB prefix layout
  • Subnetting Calculation
  • BGP ASN 4-Byte Range
  • Ethernet Planning
  • EVPN Planning Stage
  • Edge Network Handoff
• Network Provisioning workflow
  • Overview
• Input File Format Requirements (Manifest)
  • Point-to-Point (P2P) format
    • Connection Flow
    • Standard Naming Conventions for Network Components
    • GB200 Compute Tray connections
    • GB300 Compute Tray connections
    • Example Point-to-Point (P2P) format
  • SiteInfo format
    • Networking keys
    • SiteInfo YAML example
  • Factory inventory data example
  • NetworkDash UI
• Pre-Network Bringup
  • Prerequisites and inputs
  • Pre-Run Process
  • Handoff to validation
• BCM Bootstrap Workflow
  • Bootstrap Process Overview
  • Bootstrap Stages
    • Step 1 — Boot BCM
    • Step 2 — Import and copy data
    • Step 3 — Validate inputs
    • Step 4 — Generate config
    • Step 5 — Importing Objects into BCM
    • Step 6 — Provision OOB
    • Set up the Access-OOB switch
    • Step 7 — Verify connectivity
    • Step 8 — Provision fabric
• NVLink Switch Bringup Workflow
  • NVLink Switch Connectivity
    • Physical Connectivity
  • Bootstrap with BCM
    • Validating NVLink Switch Settings in BCM
    • ZTP Settings Validation
    • Power Control Validation
    • Fm Config Validation
  • Bringup NVLink Switch using ZTP
• Network Validation for North-South Network
  • Prerequisites and inputs
  • Fabric underlay routing
    • Fabric overlay routing (EVPN)
    • Show Ethernet segment information
    • Customer network reachability
    • Negative testing
    • EVPN multihoming troubleshooting reference
• Glossary of Terms