PCIe Bifurcation Configuration Options

NVIDIA ConnectX-9 SuperNIC with Down Stream provide a range of configuration scenarios to meet the demands of environments and deployments. This section describes the various connectivity options for peripherals on the PCIe, including scenarios where the ConnectX-9 SuperNIC acts as the PCIe switch with NVMe SSDs as PCIe endpoints. While this list of scenarios is not exhaustive, it highlights the tested and verified options. Customers seeking to support unlisted configurations should contact NVIDIA Support.

The SuperNIC exposes two x16 PCIe interfaces, with internal PCIe switch architecture. The first interface is exposed via the x16 PCIe Gen6 Goldfinger connector and serves as an endpoint to the host server by default. The additional PCIe x16 interface is exposed through the MCIO connector, featuring programmable bifurcation as a downstream port. The following figure demonstrates the SuperNIC block diagram with the PCIe interfaces.

The various configuration scenarios listed in this section include a diagram and instructions on how to bifurcate the PCIe interface using the mlxconfig tool. For more information on the mlxconfig tool, please refer to mlxconfig – Changing Device Configuration Tool.

Before setting the desired configuration, take note of the following warnings:

• Any customer-set configuration overrides the previous configuration values.

• Misconfiguration may harm the system.

• It is recommended to establish out-of-band connectivity to the SuperNIC before setting any of these configurations for the first time. This enables you to reset the NVConfig parameters to their default values in case of misconfiguration.

The following summarizes the available configuration scenarios.

To be updated in a future version of this document.