The chapter contains the following sections:
These are the release notes for the NVIDIA® ConnectX®-6 DE adapters firmware Rev 22.38.1900. This firmware supports the following protocols:
- InfiniBand - SDR, QDR, FDR, EDR, HDR100, HDR
- PCI Express 4.0, supporting backwards compatibility for v3.0, v2.0 and v1.1
1. Speed that supports both NRZ and PAM4 modes in Force mode and Auto-Negotiation mode.
When connecting an NVIDIA-to-NVIDIA adapter card in ETH PAM4 speeds, Auto-Neg should always be enabled.
Please make sure to use a PCIe slot that can supply the required power to the ConnectX-6 DE adapter card as stated in section Specifications in the adapter card’s User Manual.
Supported Devices
This firmware supports the devices and protocols listed below:
| NVIDIA SKU | Legacy OPN | PSID | Device Name |
|---|---|---|---|
| 900-9X0BC-001H-ST1 | MCX683105AN-HDAT | MT_0000000903 | Nvidia ConnectX-6 DE InfiniBand adapter, HDR, single-port QSFP, PCIe 4.0 x16, No Crypto, Tall Bracket |
Driver Software, Tools and Switch Firmware
The following are the drivers’ software, tools, switch/HCA firmware versions tested that you can upgrade from or downgrade to when using this firmware version:
| Supported Version | |
|---|---|
ConnectX-6 DE Firmware | 22.38.1900/ 22.37.1014/ 22.36.1010 |
MLNX_OFED | 23.07-0.5.1.2 / 23.07-0.5.0.0 / 23.04-0.5.3.3 Note: For the list of the supported Operating Systems, please refer to the driver's Release Notes. |
MLNX_EN (MLNX_OFED based code) | 23.07-0.5.0.0 / 23.04-0.5.3.3 Note: For the list of the supported Operating Systems, please refer to the driver's Release Notes. |
WinOF-2 | 23.7.50000 / 23.4.50010 Note: For the list of the supported Operating Systems, please refer to the driver's Release Notes. |
MFT | 4.25.0 / 4.24.0 Note: For the list of the supported Operating Systems, please refer to the driver's Release Notes. |
| mstflint | 4.25.0 / 4.24.0 Note: For the list of the supported Operating Systems, please refer to the driver's Release Notes. |
FlexBoot | 3.7.201 / 3.7.102 |
UEFI | 14.31.19 / 14.30.13 |
MLNX-OS | 3.10.5002 onwards |
Cumulus | 5.4 onwards |
| NVIDIA Quantum Firmware | 27.2010.5002 onwards |
SwitchX-IB 2 Firmware | 15.2010.5108 onwards |
SwitchX-IB Firmware | 11.2008.3328 onwards |
Validated and Supported Cables and Modules
NVIDIA does not support InfiniBand cables or modules not qualified or approved by NVIDIA.
Validated and Supported HDR / 200Gb/s Cables
| Speed | Cable OPN # | Description |
|---|---|---|
HDR | MCP1650-H001E30 | NVIDIA Passive Copper cable, IB HDR, up to 200Gb/s, QSFP28, PVC, 1m, white pultab, 30AWG |
HDR | MCP1650-H002E26 | NVIDIA Passive Copper cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, 2M, black pultab, 26AWG |
HDR | MCP1650-H00AE30 | NVIDIA Passive Copper cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, 0.5M, black pultab, 30AWG |
HDR | MCP7H50-H001R30 | NVIDIA Passive Copper Hybrid cable, IB HDR 200Gb/s to 2x100Gb/s, QSFP56 to 2xQSFP56, LSZH, colored pulltabs, 1m, 30AWG |
HDR | MCP7H50-H01AR30 | NVIDIA Passive Copper Hybrid cable, IB HDR 200Gb/s to 2x100Gb/s, QSFP56 to 2xQSFP56, LSZH, colored, 1.5m, 30AWG |
HDR | MCP7H50-H002R26 | NVIDIA Passive Copper Hybrid cable, IB HDR 200Gb/s to 2x100Gb/s, QSFP56 to 2xQSFP56, LSZH, colored, 2m, 26AWG |
HDR | MFS1S00-H003E | NVIDIA Active Fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 3m |
HDR | MFS1S00-H005E | NVIDIA Active Fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 5m |
HDR | MFS1S00-H010E | NVIDIA Active Fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 10m |
HDR | MFS1S00-H100E | NVIDIA Active Fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 100m |
HDR | MFS1S50-H0xxE | NVIDIA Active Fiber Splitter cable, IB HDR, 200Gb/s to 2x100Gb/s, QSFP56 to 2xQSFP56, LSZH, up to 30m |
HDR | MFS1S90-H003E | NVIDIA Active Fiber Splitter cable, IB HDR, 2x200Gb/s to 2x200Gb/s, 2xQSFP56 to 2xQSFP56, LSZH, 3m |
| HDR | MCA7J50-H003R* | NVIDIA Active Copper Hybrid cable, IB HDR 200Gb/s to 2xHDR100 100Gb/s, QSFP56 to 2xQSFP56, 3m, colored |
| HDR | MCA7J50-H004R* | NVIDIA Active Copper Hybrid cable, IB HDR 200Gb/s to 2xHDR100 100Gb/s, QSFP56 to 2xQSFP56, 4m, colored |
| HDR | MCA1J00-H003E* | NVIDIA Active Copper cable, IB HDR, up to 200Gb/s, QSFP56, 3m, yellow pulltab |
| HDR | MCA1J00-H004E* | NVIDIA Active Copper cable, IB HDR, up to 200Gb/s, QSFP56, 4m, yellow pulltab |
| HDR | MMA1T00-HS | NVIDIA transceiver, HDR, QSFP56, MPO, 850nm, SR4, up to 100m |
| HDR | MFS1S00-H130E | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 130m |
| HDR | MFS1S00-H003-LL | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, low latency, 3m |
| HDR | MFS1S00-H005-LL | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, low latency, 5m |
| HDR | MFS1S00-H010-LL | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, low latency, 10m |
| HDR | MFS1S00-H015-LL | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, low latency, 15m |
| HDR | MFS1S00-H020-LL | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, low latency, 20m |
| HDR | MFS1S00-H030-LL | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, low latency, 30m |
HDR | MCP7Y60-H001 | NVIDIA passive copper splitter cable, IB twin port HDR 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 1m |
HDR | MCP7Y60-H002 | NVIDIA passive copper splitter cable, IB twin port HDR 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 2m |
HDR | MCP7Y60-H01A | NVIDIA passive copper splitter cable, IB twin port HDR 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 1.5m |
HDR | MCP7Y70-H001 | NVIDIA passive copper splitter cable, IB twin port HDR 400Gb/s to 4x100Gb/s, OSFP to 4xQSFP56, 1m |
HDR | MCP7Y70-H002 | NVIDIA passive copper splitter cable, IB twin port HDR 400Gb/s to 4x100Gb/s, OSFP to 4xQSFP56, 2m |
HDR | MCP7Y70-H01A | NVIDIA passive copper splitter cable, IB twin port HDR 400Gb/s to 4x100Gb/s, OSFP to 4xQSFP56, 1.5m |
HDR | MFA7U10-H003 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 3m |
HDR | MFA7U10-H005 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 5m |
HDR | MFA7U10-H010 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 10m |
HDR | MFA7U10-H015 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 15m |
HDR | MFA7U10-H020 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 20m |
HDR | MFA7U10-H030 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 30m |
HDR | MFA7U10-H050 | NVIDIA AOC splitter, IB twin port HDR, 400Gb/s to 2x200Gb/s, OSFP to 2xQSFP56, 50m |
| HDR | MFS1S00-H003V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 3m |
| HDR | MFS1S00-H005V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 5m |
| HDR | MFS1S00-H010V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 10m |
| HDR | MFS1S00-H015V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 15m |
| HDR | MFS1S00-H020V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 20m |
| HDR | MFS1S00-H030V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 30m |
| HDR | MFS1S00-H050V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 50m |
| HDR | MFS1S00-H100V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 100m |
| HDR | MFS1S00-H130V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 130m |
| HDR | MFS1S00-H150E | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 150m |
| HDR | MFS1S00-H150V | NVIDIA active optical cable, up to 200Gb/s IB HDR, QSFP56, 150m |
| HDR | MFS1S00-H200E | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 200m |
| HDR | MFS1S00-H150E | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 150m |
| HDR | MFS1S00-H200E | NVIDIA active fiber cable, IB HDR, up to 200Gb/s, QSFP56, LSZH, black pulltab, 200m |
HDR links raise with RS_FEC.
*These cables were approved for switch-to-switch connectivity. For switch-to-host connectivity there may be some issues. See Known Issue 2073222/1959529 (see .Known Issues vxx.32.2000)
Validated and Supported EDR / 100Gb/s Cables
| Speed | Cable OPN | Description |
|---|---|---|
| EDR | MCP1600-E001 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 1m 30AWG |
| EDR | MCP1600-E001E30 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 1m, Black, 30AWG |
| EDR | MCP1600-E002 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 2m 28AWG |
| EDR | MCP1600-E002E30 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 2m, Black, 30AWG |
| EDR | MCP1600-E003 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 3m 26AWG |
| EDR | MCP1600-E003E26 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 3m, Black, 26AWG |
| EDR | MCP1600-E004E26 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 4m, Black, 26AWG |
| EDR | MCP1600-E005E26 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 5m, Black, 26AWG |
| EDR | MCP1600-E00A | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 0.5m 30AWG |
| EDR | MCP1600-E00AE30 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 0.5m, Black, 30AWG |
| EDR | MCP1600-E00BE30 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 0.75m, Black, 30AWG |
| EDR | MCP1600-E01A | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 1.5m 30AWG |
| EDR | MCP1600-E01AE30 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 1.5m, Black, 30AWG |
| EDR | MCP1600-E01BE30 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 1.25m, Black, 30AWG |
| EDR | MCP1600-E02A | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 2.5m 26AWG |
| EDR | MCP1600-E02AE26 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 2.5m, Black, 26AWG |
| EDR | MFA1A00-E001 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 1m |
| EDR | MFA1A00-E003 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 3m |
| EDR | MFA1A00-E005 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 5m |
| EDR | MFA1A00-E010 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 10m |
| EDR | MFA1A00-E015 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 15m |
| EDR | MFA1A00-E020 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 20m |
| EDR | MFA1A00-E030 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 30m |
| EDR | MFA1A00-E050 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 50m |
| EDR | MFA1A00-E100 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 100m |
| EDR | MMA1B00-E100 | NVIDIA transceiver, IB EDR, up to 100Gb/s, QSFP28, MPO, 850nm, SR4, up to 100m |
| EDR | MFA1A00-E003-TG | NVIDIA customized active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 3m |
| EDR | MFA1A00-E005-TG | NVIDIA customized active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 5m |
| EDR | MFA1A00-E010-TG | NVIDIA customized active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 10m |
| EDR | MFA1A00-E015-TG | NVIDIA customized active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 15m |
| EDR | MFA1A00-E020-TG | NVIDIA customized active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 20m |
| EDR | MFA1A00-E030-TG | NVIDIA customized active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 30m |
| EDR | MMA1L30-CM | NVIDIA optical module, 100Gb/s, QSFP28, LC-LC, 1310nm, CWDM4, up to 2km |
| EDR | MMS1C10-CM | NVIDIA active optical module, 100Gb/s, QSFP, MPO, 1310nm, PSM4, up to 500m |
| EDR | MFA1A00-E007 | NVIDIA active fiber cable, IB EDR, up to 100Gb/s, QSFP, LSZH, 7m |
| EDR | MCP1600-E002E26 | NVIDIA Passive Copper cable, IB EDR, up to 100Gb/s, QSFP28, 2m, Black, 26AWG |
EDR links raise with RS-FEC.
Validated and Supported FDR Cables
| Speed | Cable OPN | Description |
|---|---|---|
| FDR | MC2207128-003 | NVIDIA passive copper cable, VPI, up to 56Gb/s, QSFP, 3m |
| FDR | MC2207130-002 | NVIDIA passive copper cable, VPI, up to 56Gb/s, QSFP, 2m |
| FDR | MC220731V-005 | NVIDIA active fiber cable, VPI, up to 56Gb/s, QSFP, 5m |
| FDR | MC220731V-030 | NVIDIA active fiber cable, VPI, up to 56Gb/s, QSFP, 30m |
Validated and Supported FDR10 Cables
| Speed | Cable OPN | Description |
|---|---|---|
| FDR10 | MC2206310-003 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 3m |
| FDR10 | MC2206310-005 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 5m |
| FDR10 | MC2206310-010 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 10m |
| FDR10 | MC2206310-015 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 15m |
| FDR10 | MC2206310-020 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 20m |
| FDR10 | MC2206310-030 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 30m |
| FDR10 | MC2206310-050 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 50m |
| FDR10 | MC2206310-100 | NVIDIA active fiber cable, IB QDR/FDR10, 40Gb/s, QSFP, 100m |
Tested Switches
Tested HDR / 200Gb/s Switches
| Speed | Switch Silicon | OPN # / Name | Description | Vendor |
|---|---|---|---|---|
HDR | Quantum | MQM8700-xxx | 40-port Managed Non-blocking HDR 200Gb/s InfiniBand Smart Switch | NVIDIA |
HDR | Quantum | MQM8790-xxx | 40-port Unmanaged, Non-blocking HDR 200Gb/s InfiniBand Smart Switch | NVIDIA |
Tested EDR / 100Gb/s Switches
| Speed | Switch Silicon | OPN # / Name | Description | Vendor |
|---|---|---|---|---|
EDR | Switch-IB | MSB7790-XXX | 36-port Unmanaged EDR 100Gb/s InfiniBand Switch Systems | NVIDIA |
EDR | Switch-IB | MSB7700-XXX | 36-port Managed EDR 100Gb/s InfiniBand Switch Systems | NVIDIA |
EDR | Switch-IB 2 | MSB7800-XXX | 36-port Managed EDR 100Gb/s InfiniBand Switch Systems | NVIDIA |
PRM Revision Compatibility
This firmware version complies with the following Programmer’s Reference Manual:
- Adapters Programmer’s Reference Manual (PRM), Rev 0.53 or later, which has Command Interface Revision 0x5. The command interface revision can be retrieved by means of the QUERY_FW command and is indicated by the field cmd_interface_rev.
