Cable Installation

NVIDIA Spectrum-4 SN5000 2U Switch Systems Hardware User Manual

All cables can be inserted or removed with the unit powered on.

To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The LED indicator, corresponding to each data port, will light orange when the physical connection is established. When a logical connection is made, the LED color will change to green .

To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator for that port will turn off when the cable is unseated.

For a list of Supported Cables and Transceivers, please refer to the SN5000 Systems Datasheet.

For full cabling guidelines, ask your NVIDIA representative for a copy of NVIDIA Cable Management Guidelines and FAQs Application Note.

For more information about port LEDs, refer to Port LEDs.

Important

Do not push the cable connector into the receptacle using excessive force, as this may cause damage to the cable or to the cage.

QSFP Cable Orientation

image2023-8-2_8-52-37-version-1-modificationdate-1690991558600-api-v2.png

When using an NVIDIA splitter cable, the following splitting options are available:

  • SN5400 (see "Splitting Options”):

    • When running at a 50GbE per lane, each 400GbE port can be split to 2 ports of 200GbE or 4 ports of 100GbE without any limitation, or 8 ports of 50GbE while disabling (unmapping) the 50GbE port above or below it.

    • When running at a 25GbE per lane, each 200GbE port can be split to 2 ports of 100GbE or 4 ports of 50GbE without any limitation.

  • SN5600 (see "Splitting Options”):

    • When running at 100GbE per lane, each 800GbE port can be split to 4 ports of 200GbE without any limitation, or 4 odd ports of 100GbE while disabling (unmapping) even ports.

    • When running at a 50GbE per lane, each 400GbE port can be split to 2 ports of 200GbE or 4 ports of 100GbE without any limitation.

    • When running at 25GbE, each 200GbE port can be split to 2 ports of 100GbE or 4 ports of 50GbE without any limitation.

Using Splitter (Breakout) Cables with Cumulus Linux

If you are using splitter cables, edit the /etc/cumulus/ports.conf to enable support for these cables, and restart the switchd service using the sudo systemctl restart switchd command. For more details, see Switch Port Attributes in the Cumulus Linux User Guide.

Examples of Splitter (Breakout or Fanout) Cables

image2018-11-12_16-34-27-version-1-modificationdate-1681666273337-api-v2.png


Splitting Options

Warning

The following diagram shows the systems' ports non-blocking splitting capability to two and four ports each. In addition, each of the ports can be split to 8, while disabling the adjacent port. I.e - when splitting port no. 1, port no. 2 will be blocked, when splitting port no. 6, port no. 5 will be blocked, etc.

image-2024-1-31_17-38-15-version-1-modificationdate-1706715497227-api-v2.png

image2023-3-19_13-41-45-version-1-modificationdate-1681666274963-api-v2.png

image2023-3-19_13-42-25-version-1-modificationdate-1681666275027-api-v2.png


The SN5600 systems are using OSFP cages, which are able of working in speeds of 800G, 2x400G or 4x200G, as well as 8x100G when using a split fiber.​

The OSFP based optcial transceivers have two distinctive ports that can be used as OSFP transceivers inserted to the switch in a “Belly-to-Belly" configuration, meaning that the transceiver on the top will be "right-side-up“, and the transceiver below it will be "right-side-down".​

OSFP Transceiver Illustration

image-2024-2-28_1-24-8-version-1-modificationdate-1709076250100-api-v2.png

The illustarion below depicts the numbering of the ports in 2x400G and 4x200G modes​.

Connector #

800G Port #

image-2024-2-28_11-3-24-version-1-modificationdate-1709111004723-api-v2.png

image-2024-2-28_11-4-40-version-1-modificationdate-1709111080667-api-v2.png

image-2024-2-28_10-59-0-version-1-modificationdate-1709110740983-api-v2.png

image-2024-2-28_1-7-12-version-1-modificationdate-1709075233607-api-v2.png

Port Configuration

Physical Connector

NOS Description

Examples

800G​

C1​

swp​

swp1, swp2​

Breakout Ports Reflection in NOS​

The illustration below shows the first two rows of the system’s OSFP carriers , where the left part identifies the OSFP cage number , as it is presented by the OS, and the right part identifies the corresponding subinterafces.

Connector #

2x400G

Connector #

4x200G

image-2024-2-28_1-15-2-version-1-modificationdate-1709075704210-api-v2.png

image-2024-2-28_1-15-35-version-1-modificationdate-1709075736757-api-v2.png

Port Configuration

Physical Connector

Subinterface

Examples

2x400G ​

C1​

s1​

swp1s1, swp24s1​

C2​

s2​

swp1s2, swp64s2​

4x200G​

C1​

s1, s2​

swp2s1, swp2s2​

C2​

s3, s4​

swp8s3, swp8s4​

8x100G​

C1​

s1, s2, s3, s4​

swp60s1, swp60s2, swp60s3, swp60s4​

C2​

s5, s6, s7, s8​

swp55s5, swp55s6, swp55s7, swp55s8​


© Copyright 2024, NVIDIA. Last updated on Feb 1, 2024.