About This Manual
This is the User Guide for Ethernet NVIDIA® ConnectX®-6 Dx adapter cards for Open Compute Project Spec 3.0. These adapters' connectivity provides the highest performing low latency and most flexible interconnect solution for servers supporting OCP spec 3.0 adapter cards used in Enterprise Data Centers and High-Performance Computing environments.
Important Note:
In some of the OCP 3.0 prototype samples, the insertion force that is required to install the card into a particular PCI connector may exceed the maximum insertion force that is allowed by the connector’s spec. NVIDIA is updating the OCP 3.0 cards to ensure the proper insertion process.
Ordering Part Numbers
The table below provides the ordering part numbers (OPN) for the available ConnectX-6 Dx Ethernet adapter cards for OCP Spec 3.0.
|
NVIDIA SKU |
OPN |
Marketing Description |
|
900-9X658-0076-MB0 |
MCX623436MS-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket |
|
900-9X675-0076-MB0 |
MCX623430MS-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port DSFP, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket |
|
900-9X658-0086-SB0(a) |
MCX623436AC-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket |
|
900-9X658-0056-SB1 |
MCX623436AN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket |
|
900-9X658-0046-SI0 |
MCX623435AC-CDAI |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Internal Lock Bracket |
|
Note: (a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA ConnectX-6 Dx Cards Product Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document. | ||
Legacy (EOL) Ordering Part Numbers
|
NVIDIA SKU |
OPN |
Marketing Description |
NVIDIA SKU |
OPN |
Marketing Description |
|
900-9X658-0076-MB0 |
MCX623436MS-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X675-0076-MB0 |
MCX623430MS-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port DSFP, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0086-SB0(a) |
MCX623436AC-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0056-SB1 |
MCX623436AN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0046-SI0 |
MCX623435AC-CDAI |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Internal Lock Bracket | |||
|
Note: (a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA ConnectX-6 Dx Cards Product Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document. | |||||
|
900-9X624-0073-SB0 |
MCX623432AS-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host management, Dual-port SFP28, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0063-SB0 |
MCX623432AE-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host Management, Dual-port SFP28, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0085-SB0 |
MCX623432AC-GDAB |
ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0075-SI0 |
MCX623432AS-GDAI |
ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket | |||
|
900-9X658-0016-SB0 |
MCX623435AN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0046-SB0(a) |
MCX623435AC-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0056-MB0 |
MCX623436MN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0026-SB0 |
MCX623435AE-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0038-SI0 |
MCX623435AS-VDAI |
ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket | |||
|
900-9X658-0066-SB0 |
MCX623436AE-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0076-SI0 |
MCX623436AS-CDAI |
ConnectX®-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket | |||
|
900-9X675-0046-MB0 |
MCX623439MC-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0083-SB0 |
MCX623432AC-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host Management, Dual-port SFP28, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0003-SB0 |
MCX623432AN-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host management, Dual-port SFP28, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0055-SB0 |
MCX623432AN-GDAB |
ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0048-SB0 |
MCX623435AC-VDAB |
ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0016-MB0 |
MCX623435MN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0018-SB0 |
MCX623435AN-VDAB |
ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
Intended Audience
This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with the Ethernet network and architecture specifications.
Technical Support
Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods:
URL: https://www.nvidia.com > Support
E-mail: enterprisesupport@nvidia.com
Customers who purchased NVIDIA Global Support Services, please see your contract for details regarding Technical Support.
Customers who purchased NVIDIA products through an NVIDIA-approved reseller should first seek assistance through their reseller.
Related Documentation
|
NVIDIA SKU |
OPN |
Marketing Description |
NVIDIA SKU |
OPN |
Marketing Description |
|
900-9X658-0076-MB0 |
MCX623436MS-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X675-0076-MB0 |
MCX623430MS-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port DSFP, Multi-Host or Socket Direct, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0086-SB0(a) |
MCX623436AC-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0056-SB1 |
MCX623436AN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0046-SI0 |
MCX623435AC-CDAI |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Internal Lock Bracket | |||
|
Note: (a) If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA ConnectX-6 Dx Cards Product Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document. | |||||
|
900-9X624-0073-SB0 |
MCX623432AS-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host management, Dual-port SFP28, PCIe 4.0 x16, Secure Boot, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0063-SB0 |
MCX623432AE-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host Management, Dual-port SFP28, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0085-SB0 |
MCX623432AC-GDAB |
ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0075-SI0 |
MCX623432AS-GDAI |
ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket | |||
|
900-9X658-0016-SB0 |
MCX623435AN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0046-SB0(a) |
MCX623435AC-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0056-MB0 |
MCX623436MN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host management, Dual-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0026-SB0 |
MCX623435AE-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0038-SI0 |
MCX623435AS-VDAI |
ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket | |||
|
900-9X658-0066-SB0 |
MCX623436AE-CDAB |
ConnectX-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto, No Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0076-SI0 |
MCX623436AS-CDAI |
ConnectX®-6 Dx EN adapter card, 100GbE OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Secure Boot, No Crypto, Internal Lock Bracket | |||
|
900-9X675-0046-MB0 |
MCX623439MC-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0083-SB0 |
MCX623432AC-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host Management, Dual-port SFP28, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0003-SB0 |
MCX623432AN-ADAB |
ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host management, Dual-port SFP28, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X624-0055-SB0 |
MCX623432AN-GDAB |
ConnectX®-6 Dx EN adapter card, 50GbE, OCP3.0, With Host Management, Dual-port SFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0048-SB0 |
MCX623435AC-VDAB |
ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0016-MB0 |
MCX623435MN-CDAB |
ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Single-port QSFP56, Multi-Host or Socket Direct, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
900-9X658-0018-SB0 |
MCX623435AN-VDAB |
ConnectX®-6 Dx EN adapter card, 200GbE, OCP3.0, With Host Management, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Thumbscrew (Pull Tab) Bracket | |||
|
NVIDIA OFED for Linux User Manual and Release Notes |
User Manual describing OFED features, performance, band diagnostic, tools content, and configuration. See NVIDIA OFED for Linux Documentation. | ||||
|
WinOF-2 for Windows User Manual and Release Notes |
User Manual describing WinOF-2 features, performance, Ethernet diagnostic, tools content, and configuration. See WinOF-2 for Windows Documentation. | ||||
|
NVIDIA VMware for Ethernet User Manual and Release Notes |
User Manual describing the various components of the NVIDIA ConnectX® NATIVE ESXi stack. See http://www.nvidia.com Products > Software > Ethernet Drivers > VMware Driver | ||||
|
NVIDIA Firmware Utility (mlxup) User Manual and Release Notes |
NVIDIA firmware update and query utility used to update the firmware. See http://www.nvidia.com > Products > Software > Firmware Tools >mlxup Firmware Utility | ||||
|
NVIDIA Firmware Tools (MFT) User Manual |
User Manual describing the set of MFT firmware management tools for a single node. See MFT User Manual. | ||||
|
IEEE Std 802.3 Specification |
IEEE Ethernet specification at http://standards.ieee.org/ | ||||
|
PCI Express Specifications |
Industry Standard PCI Express Base and Card Electromechanical Specifications at https://pcisig.com/specifications | ||||
|
Open Compute Project 3.0 Specification | |||||
|
NVIDIA LinkX Interconnect Solutions |
NVIDIA LinkX cables and transceivers are designed to maximize the performance of High-Performance Computing networks, requiring high-bandwidth, low-latency connections between compute nodes and switch nodes. NVIDIA offers one of the industry’s broadest portfolios of 40Gb/s, 56Gb/s, 100Gb/s, and 200Gb/s cables, including Direct Attach Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs), and transceivers in a wide range of lengths from 0.5m to 10km. NVIDIA tests every product in an end-to-end environment ensuring a Bit Error Rate of less than 1E-15 . Read more at https://www.nvidia.com/products/interconnect/ethernet-overview.php | ||||
|
NVIDIA ConnectX-6 Dx Cards Product Release Notes |
Describes the hardware release notes for the ConnectX-6 Dx adapters. To access the document, log into NVOnline or contact your NVIDIA representative. | ||||
Document Conventions
When discussing memory sizes, MB and MBytes are used in this document to mean size in MegaBytes. The use of Mb or Mbits (small b) indicates the size in Megabits. In this document, PCIe is used to mean PCI Express.