NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual

PDF

You can download a PDF version of the full guide here.

About This Manual

This is the User Guide for Ethernet NVIDIA® ConnectX®-6 Dx adapter cards for Open Compute Project Spec 3.0. These adapters' connectivity provides the highest performing low latency and most flexible interconnect solution for servers supporting OCP spec 3.0 adapter cards used in Enterprise Data Centers and High-Performance Computing environments.

Important Note:

In some of the OCP 3.0 prototype samples, the insertion force that is required to install the card into a particular PCI connector may exceed the maximum insertion force that is allowed by the connector’s spec. NVIDIA is updating the OCP 3.0 cards to ensure the proper insertion process.

Ordering Part Numbers

The table below provides the ordering part numbers (OPN) for the available ConnectX-6 Dx Ethernet adapter cards for OCP Spec 3.0.

NVIDIA SKU

OPN

Marketing Description


900-9X624-0073-SB0

MCX623432AS-ADAB

ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host management, Dual-port SFP28, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0016-SB0

MCX623435AN-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0046-SB0(a)

MCX623435AC-CDAB

ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X658-0056-MB0

MCX623436MN-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0076-MB0

MCX623436MS-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X675-0076-MB0

MCX623430MS-CDAB

ConnectX-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port DSFP, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0086-SB0(a)

MCX623436AC-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X658-0056-SB1

MCX623436AN-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0046-SI0

MCX623435AC-CDAI

ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Internal Lock Bracket

Note:(a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA ConnectX-6 Dx Cards Product Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.

Legacy (EOL) Ordering Part Numbers


NVIDIA SKU


OPN


Marketing Description


900-9X624-0063-SB0

MCX623432AE-ADAB

ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host Management, Dual-port SFP28, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X624-0085-SB0

MCX623432AC-GDAB

ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X624-0075-SI0

MCX623432AS-GDAI

ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket

900-9X658-0026-SB0

MCX623435AE-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X658-0038-SI0

MCX623435AS-VDAI

ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket

900-9X658-0066-SB0

MCX623436AE-CDAB

ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X658-0076-SI0

MCX623436AS-CDAI

ConnectX®-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket

900-9X675-0046-MB0

MCX623439MC-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X624-0083-SB0

MCX623432AC-ADAB

ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host Management, Dual-port SFP28, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X624-0003-SB0

MCX623432AN-ADAB

ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host management, Dual-port SFP28, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X624-0055-SB0

MCX623432AN-GDAB

ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0048-SB0

MCX623435AC-VDAB

ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket

900-9X658-0016-MB0

MCX623435MN-CDAB

ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

900-9X658-0018-SB0

MCX623435AN-VDAB

ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket

Intended Audience

This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with the Ethernet network and architecture specifications.

Technical Support

Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods:

Customers who purchased NVIDIA Global Support Services, please see your contract for details regarding Technical Support.Customers who purchased NVIDIA products through an NVIDIA-approved reseller should first seek assistance through their reseller.
Related Documentation


NVIDIA OFED for Linux User Manual and Release Notes

User Manual describing OFED features, performance, band diagnostic, tools content, and configuration. See NVIDIA OFED for Linux Documentation.

WinOF-2 for Windows User Manual and Release Notes

User Manual describing WinOF-2 features, performance, Ethernet diagnostic, tools content, and configuration. See WinOF-2 for Windows Documentation.

NVIDIA VMware for Ethernet User Manual and Release Notes

User Manual describing the various components of the NVIDIA ConnectX® NATIVE ESXi stack. See http://www.nvidia.com Products > Software > Ethernet Drivers > VMware Driver

NVIDIA Firmware Utility (mlxup) User Manual and Release Notes

NVIDIA firmware update and query utility used to update the firmware. See http://www.nvidia.com > Products > Software > Firmware Tools >mlxup Firmware Utility

NVIDIA Firmware Tools (MFT) User Manual

User Manual describing the set of MFT firmware management tools for a single node. See MFT User Manual.

IEEE Std 802.3 Specification

IEEE Ethernet specification at http://standards.ieee.org/

PCI Express Specifications

Industry Standard PCI Express Base and Card Electromechanical Specifications at https://pcisig.com/specifications

Open Compute Project 3.0 Specification

https://www.opencompute.org/

NVIDIA LinkX Interconnect Solutions

NVIDIA LinkX cables and transceivers are designed to maximize the performance of High-Performance Computing networks, requiring high-bandwidth, low-latency connections between compute nodes and switch nodes. NVIDIA offers one of the industry’s broadest portfolios of 40Gb/s, 56Gb/s, 100Gb/s, and 200Gb/s cables, including Direct Attach Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs), and transceivers in a wide range of lengths from 0.5m to 10km. NVIDIA tests every product in an end-to-end environment ensuring a Bit Error Rate of less than 1E-15 . Read more at https://www.nvidia.com/products/interconnect/ethernet-overview.php

NVIDIA ConnectX-6 Dx Cards Product Release Notes

Describes the hardware release notes for the ConnectX-6 Dx adapters. To access the document, log into NVOnline or contact your NVIDIA representative.

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in MegaBytes. The use of Mb or Mbits (small b) indicates the size in Megabits. In this document, PCIe is used to mean PCI Express.

© Copyright 2023, NVIDIA. Last updated on Jun 1, 2023.