NVIDIA RTX PRO AI Factory

NVIDIA Enterprise Reference Architecture

• Abstract
• Overview
  • Use Cases
• Components
  • NVIDIA RTX PRO Servers
  • NVIDIA RTX PRO 6000 Blackwell Server Edition GPU
    • NVIDIA-Certified Systems and 2-8-5-200 Configuration
  • Control Plane/Management Nodes
  • Networking
    • Compute (Node East/West) Ethernet Networking
    • Converged (Node North/South) Ethernet Networking
• Networking Hardware
  • NVIDIA BlueField-3 B3140H SuperNIC
  • NVIDIA BlueField-3 B3220 DPU
  • NVIDIA SN5610 Switch
  • NVIDIA SN2201 Switch
• Networking Physical Topologies
  • Compute (Node East/West) Network
    • A Note on Pure Inference Deployments
  • CPU Converged (Node North/South) Network
  • Out-of-Band Management (Node) Network
• Networking Logical Architecture
  • Enterprise RA Scalable Unit (SU)
  • Spine-Leaf Networking
  • Out-of-Band (OOB) Management Network
  • Optimized Use Case
    • Architecture Details
    • Converged (Node North/South) Fabric Table
    • 16 Nodes with 128 GPUs
    • 32 Nodes with 256 GPUs
• Software
• NVIDIA-Certified Storage
• Services
• Summary

Appendix

• Appendix
  • Compute Nodes
  • Switches and Cables

Notices

• Notices
  • Notice
  • Trademarks
  • Copyright