Q3200-RA/Q3400-RA XDR 800Gb/s InfiniBand Switch Systems User Manual

Cable Installation

In some switch models, the product's package includes cable retainers. It is highly recommended to use them in order to secure the power cables in place.

When installing retainers for the PSUs of the switch systems, please adhere to the following instructions:

  1. Verify the integrity of the retainer assembly, as demonstrated in the below table:- The snaps' push-pins must have visible edges with no broken or torn parts.

    - The shoulders' pins should be in-tact and must not be bent inwards.

    Proper Condition

    Improper Condition

    image2021-3-8_13-43-33-version-1-modificationdate-1738837751157-api-v2.png

    image2021-3-8_13-42-12-version-1-modificationdate-1738837751410-api-v2.png

  2. It is advised to place the PSU on a flat, stable surface. While you secure the PSU in place, use two thumbs to insert the retainer's two snaps into the designated holes located near the AC inlet. Make sure that the retainer's plastic loop is facing upwards, as demonstrated in the below table.

    Note

    For demonstration purposes, the images in this document show C2P (Connector-to-Power) airflow PSUs with red latches, yet the instructions apply to P2C (Power-to-Connector) PSUs with blue latches as well.

    Correct Insertion

    Incorrect Insertion

    image2022-2-23_14-59-39-version-1-modificationdate-1738837749927-api-v2.png

    image2022-2-23_14-58-45-version-1-modificationdate-1738837749557-api-v2.png

  3. Push the retainer until the shoulders' pins (in blue circles below) are open and aligned with the PSU front panel, as shown in the following table:

    Fully Mated Retainer

    image2022-2-23_15-1-16-version-1-modificationdate-1738837750183-api-v2.png

    image-2024-1-17_16-0-59-version-1-modificationdate-1738837763010-api-v2.png

  4. Make sure that the retainer is fully locked in place by gently attempting to pull it outwards.

  5. Open the plastic loop and route the AC cord through it. Locate the loop over the AC cord, as shown in the following table, and fasten it tightly.

    Proper Loop Placement

    Improper Loop Placement

    image2022-2-23_15-9-13-version-1-modificationdate-1738837750473-api-v2.png

    image2022-2-23_15-9-56-version-1-modificationdate-1738837750850-api-v2.png

Note

Each cable retainer can be used once only. Once the retainer has been fully inserted and the shoulders' pins have been adjusted, the retainer cannot be used again, and should be discarded if pulled out.

All cables can be inserted or removed with the unit powered on.

To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The LED indicator, corresponding to each data port, will light when the physical connection is established. When a logical connection is made, the relevant port LED will turn on.

To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator for that port will turn off when the cable is unseated.

For full cabling guidelines, ask your NVIDIA representative for a copy of NVIDIA Cable Management Guidelines and FAQs Application Note.

For more information about port LEDs, refer to Port LEDs.

Warning

Do not force the cable into the cage with more than 40 newtons/9.0 pounds/4kg force. Greater insertion force may cause damage to the cable or to the cage.

Note

Unused OSFP cages must be closed with the thermal caps supplied with the system.

image2021-12-1_11-35-14-version-1-modificationdate-1738837753123-api-v2.png

Cable Orientation

image2021-12-1_11-2-31-version-1-modificationdate-1738837752320-api-v2.png

image2021-12-1_10-57-20-version-1-modificationdate-1738837751697-api-v2.png

image2021-12-1_11-3-22-version-1-modificationdate-1738837752560-api-v2.png

image2021-12-1_10-57-20-version-1-modificationdate-1738837751697-api-v2.png

Splitter (Breakout) Cables and Adapters

In the XDR systems, a single OSFP cage contains 2 XDR ports. This maximizes flexibility by enabling end users to use a combination of dual-lane and quad-lane interfaces according to the specific requirements of their network. For the systems splitting options, see Splitting Options below.

For the Q3200 switch system:

Splitting a port changes the notation of that port from x/y/z to x/y/z/i, with “x/y/z” indicating the previous notation of the port prior to the split, and “i” indicating the number of the resulting single-lane port (1,2). Each sub-physical port is then handled as an individual port. For example, splitting port 1/5/1 into 2 lanes results in ports 1/5/1/1 and 1/5/1/2. For full notation schematics, see Port Notation Schematics.

For the Q3400 switch system:

Splitting a port changes the notation of that port from x to x/y, with “x” indicating the previous notation of the port prior to the split, and “y” indicating the number of the resulting XDR port. Each XDR port is then handled as an individual port. For example, splitting port 1 into 2 ports results in ports 1/1 and 1/2. For full notation schematics, see Port Notation Schematics.

Note

The following behavior should be expected when disconnecting a 1:2 splitter cable (from cages in both the upper and lower rows):

  • When you disconnect a cable marked as “1”, the CLI <cage number>/1 will always go down, and the left LED of the cage will be turned off.

  • When you disconnect the cable marked as “2”, the CLI <cage number>/2 will always go down, and the right LED of the cage will be turned off.

Breakout Cable Example

image2021-11-3_14-30-54-version-1-modificationdate-1738837761433-api-v2.png

Tip
  • Splitting the interface deletes all configuration on that interface.

  • In order to be able to use this feature, the system profile command must be activated with split-ready configuration (cross-reference to system profile command).

  • Changes will take effect after reset. In order to reset an unmanaged switch, please reboot the switch, or run flint -d <device> swreset.

For more information on how to change the system’s profile to allow Split-Ready configuration, how to change the module type to a split mode, and how to unsplit a split port when using the switch systems, please refer to the "InfiniBand Switching" chapter in the latest MLNX-OS® User Manual.

Splitting Options

Q3200-RA Splitting Options

The following diagram shows ASIC A and ASIC B, as well as the cage numbers. Each cage splits into two. For example : ASIC A/Cage1/ has both Port1 and Port2:

image-2024-9-29_11-54-34-version-1-modificationdate-1738837745423-api-v2.png

The following diagram shows the ASIC/Cage/Port/Split numbering:

image-2024-9-29_11-55-8-version-1-modificationdate-1738837745123-api-v2.png

Port Notation Schematics for Q3400-RA Cage/Port profile :

image-2024-11-18_12-21-31-version-1-modificationdate-1738837744463-api-v2.png

Logical Port Numbering Schematic

© Copyright 2025, NVIDIA. Last updated on Feb 16, 2025.