Hardware Installation

NVIDIA MetroX-3 XC TQ8400 Long-haul 1U Appliance User Manual

The installation of the MetroX-3 XC systems requires attention to the mechanical and power elements of the appliance and precautions must be taken for the rack-mounted equipment.
The system platform can be rack-mounted and is designed for installation in a standard 19” rack. The power side of the system includes a hot-swap power supply unit (PSU), space for an optional second PSU (purchased separately) for redundancy, and replaceable fan trays. There is one possible airflow direction. It is necessary to validate that the system airflow direction is compatible with the system, rack, and PSUs. The rear panel of the system has the QSFP28 ports, system LEDs, and management connection ports.
Use a rack capable of supporting the mechanical and environmental characteristics of a fully-populated platform.

Important

The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take precautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature.

The installation procedure of NVIDIA MetroX-3 XC systems involves the following steps.

Step

Procedure

Direct Link

1

Follow safety warning procedures.

Refer to Safety Warnings.

2

Pay attention to the system considerations within the host chassis.

Refer to System Requirements.

3

Follow the safety precautions

Refer to Safety Precautions.

4

Unpack the package and confirm that you have received all the
required components.

Refer to Unpacking the Package.

5

Mount the appliance in a rack enclosure.

Refer to Installing the Appliance in the Rack.

6

Use the supplied cables to connect the system

Refer to Cable Installation.

7

Power on the system.

Refer to Initial Power-On.

Safety Warnings

Note

Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Safety Instructions for Gateway document available on mellanox.com.

Please observe all safety warnings to avoid injury and prevent damage to system components. Note that not all warnings are relevant to all models.

image2021-9-26_12-44-2.png

Installation Instructions

Read all installation instructions before connecting the equipment to the power source.

image2021-8-11_8-44-35.png

Bodily Injury Due to Weight

Use enough people to lift this product safely.

image2018-11-28_13-36-7.png

image2021-8-11_8-44-35.png

Heavy Equipment
This heavy equipment should be moved using a mechanical lift to avoid injuries.

image2021-8-11_8-56-28.png

Risk of Electric Shock!

  • With the fan module removed power pins are accessible within the module cavity.
    Do not insert tools or body parts into the fan module cavity.

  • For AC powered switch systems: Disconnecting one power supply only disconnects one module. To isolate the unit completely, all connected power supplies must be disconnected.

    image2020-2-17_11-14-1.png

    In QM97X0/HGX H100 switch systems: for 200-240Vac use only

image2021-9-26_12-44-2.png

Over-temperature
This equipment should not be operated in an area with an ambient temperature exceeding the maximum value listed in the product specifications. Moreover, to guarantee proper ventilation, allow at least 8 cm (3 inches) of clearance around the ventilation openings.

image2021-8-11_8-44-35.png

Stacking the Chassis
The chassis should not be stacked on any other equipment. If the chassis falls, it can cause bodily injury and equipment damage.

image2021-8-11_8-56-28.png

Redundant Power Supply Connection (OPTIONAL)—Electrical Hazard
This product includes a redundant power or a blank in its place. In case of a blank power supply, do not operate the product with the blank cover removed or not securely fastened.

image2021-8-11_8-44-35.png

Double Pole/Neutral Fusing
This system has double pole/neutral fusing. Remove all power cords before opening the cover of this product or touching any internal parts.

image2021-8-11_8-56-28.png

Multiple Power Inlets
Risk of electric shock and energy hazard. The PSUs are all independent. Disconnect all power supplies to ensure a powered down state inside of the switch platform.

image2021-8-11_8-56-28.png

During Lightning—Electrical Hazard

During periods of lightning activity, do not work on the equipment or connect or disconnect cables.

image2021-9-26_12-44-2.png

Copper Cable Connecting/Disconnecting
Copper cables are heavy and not flexible, as such they should be carefully attached to or detached from the connectors. Refer to the cable manufacturer for special warnings/instructions.

image2021-8-11_8-44-35.png

Rack Mounting and Servicing
When this product is mounted or serviced in a rack, special precautions must be taken to ensure that the system remains stable. In general, the rack should be filled with equipment starting from the bottom to the top.

image2021-9-26_12-44-2.png

Equipment Installation
This equipment should be installed, replaced, and/or serviced only by trained and qualified personnel.

image2021-9-26_12-44-2.png

Equipment Disposal
Disposal of this equipment should be in accordance to all national laws and regulations.

image2021-9-26_12-44-2.png

Local and National Electrical Codes

This equipment should be installed in compliance with local and national electrical codes.

image2021-9-26_12-44-2.png

Installation Codes
This device must be installed according to the latest version of the country national electrical codes. For North America, equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electrical Code.

image2021-8-11_8-44-35.png

Battery Replacement
Warning: Replace only with UL Recognized battery, certified for maximum abnormal charging current not less than 4mA. There is a risk of explosion should the battery be replaced with a battery of an incorrect type. Dispose of used batteries according to the instructions.

image2021-9-26_12-44-2.png

UL Listed and CSA Certified Power Supply Cord
For North American power connection, select a power supply cord that is UL Listed and CSA Certified, 3 - conductor, [16 AWG], terminated with a molded plug rated at 125 V, [13 A], with a minimum length of 1.5m [six feet] but no longer than 4.5m.
For European connection, select a power supply cord that is internationally harmonized and marked “<HAR>”, 3 - conductor, minimum 1.0 mm2 wire, rated at 300 V, with a PVC insulated jacket. The cord must have a molded plug rated at 250 V, 10 A.

image2021-8-11_8-44-35.png

Installation Codes
This device must be installed according to the latest version of the country's national electrical codes. For North America, equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electrical Code.

image2021-9-26_12-44-2.png

Interconnection of Units
Cables for connecting to the unit RS232 and Ethernet Interfaces must be UL certified type DP-1 or DP-2. (Note: when residing in non LPS circuit.)

image2021-9-26_12-44-2.png

Overcurrent Protection
A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be incorporated in the building wiring.

Acoustic Level Warning

The acoustic level listed in Specifications section represents product noise measured in accordance with ISO 7779 under nominal conditions. The actual noise level can vary depending on the installation conditions, including but not limited to the number of racks in the installation, the overall installation size, rack and other equipment material and noise levels, fan faults, room temperature, room configuration, and employee location in relation to the equipment. The data-center owner should manage effective hearing conservation as per the OSHA standard to protect employees against over and extended exposure to noise.

image2018-11-28_13-42-34.png

Do Not Use the Switch as a Shelf or Work Space
Caution: Slide/rail mounted equipment is not to be used as a shelf or a work space. The rails are not intended for sliding the unit away from the rack. It is for permanent installation at final resting place only, not used for service and maintenance.

image2018-11-28_13-42-55.png

WEEE Directive
According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE) should be collected separately and not disposed of with regular household waste. Dispose of this product and all of its parts in a responsible and environmentally-friendly way.

image2021-9-26_12-44-2.png

Country of Norway Power Restrictions
This unit is intended for connection to a TN power system and an IT power system of Norway only.

Taiwan RoHS Declaration - Switch Systems

image2022-2-14_10-14-58.png


Taiwan RoHS Declaration - Gateway Systems

image2022-8-1_17-33-42.png


Taiwan BSMI Class A Statement - Warning to the User!

警告:為避免電磁干擾,本產品不應安裝或使用於住宅環境。

System Requirements

Hardware Requirements

Important

Unless otherwise specified, NVIDIA Networking products are designed to work in an environmentally controlled data center with low levels of gaseous and dust (particulate) contamination.

The operating environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness level.


Airflow Requirements

NVIDIA MetroX-3 XC is offered with one airflow pattern: from the front panel to the rear panel. Please refer to the Technical Specifications section for airflow numbers

Software Requirements

See Operating Systems section under the Introduction section

Unpacking the Package

Safety Precautions

The NVIDIA MetroX-3 XC is installed in systems that operate with voltages that can be lethal. Before opening the case of the system, observe the following precautions to avoid injury and prevent damage to system components.

  • Remove any metallic objects from your hands and wrists.

  • Make sure to use only insulated tools.

  • Verify that the system is powered off and is unplugged.

  • Place the ESD mat on the floor where working and put on the ESD strap. Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground.

Package Contents

Unpack the system, and make sure that all the parts have been sent against the parts list below. Check the parts for visible damage that may have occurred during shipping.

The appliance comes packed with the following items:

  • 1X – bezel

  • 1X – appliance

  • 2X – installation rails, one right hand and one left hand

  • 2X – power cable per PS unit (type C13-C14)

  • 1X – Ethernet CAT6A cable (RJ45-to-RJ45), 2m

Installing the Appliance in Rack

  1. Pull the inner rails out of the rack until they lock into place.

    pull-out-inner-rail.png

  2. Locate the rear rail standoff on each side of the system and lower them into the rear J-slots on the slide assemblies.

  3. Rotate the system downward until all the rail standoffs are seated in the J-slots.

    rail-standoffs-seated-in-j-slots.png

  4. Push the system inward until the lock levers click into place.

  5. Pull the blue side release lock tabs forward or backward on both rails and slide the system into the rack until the system is in the rack.

    slide-system-into-rack.png

  6. Ground the appliance (see "Grounding the Appliance").

  7. Plug in the power cables (see "Power Connections and Initial Power On").

  8. Push the ON/OFF button to start.

    image2023-1-18_12-48-28.png

  9. Check the Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation.

Warning

Any amber status LEDs are a cause for concern and must be dealt with immediately. It can take up to 5 minutes to boot up, during which time the status LED may indicate red.

Warning

Rack Mount Instructions (similar rack-mount instructions are included with the installation instructions):

  • Elevated Operating Ambient—If installed in a closed or multi-unit rack assembly, the operating ambient temperature of the rack environment may be greater than the room ambient. Therefore, consideration should be given to installing the equipment in an environment compatible with the maximum ambient temperature (Tma) specified by the manufacturer.

  • Reduced Air Flow— Installation of the equipment in a rack should be such that the amount of airflow required for the safe operation of the equipment is not compromised.

  • Mechanical Loading—Mounting of the equipment in the rack should be such that a hazardous condition is not achieved due to uneven mechanical loading.

  • Circuit Overloading—Consideration should be given to the connection of the equipment to the supply circuit and the effect that overloading of the circuits might have on overcurrent protection and supply wiring. Appropriate consideration of equipment nameplate ratings should be used when addressing this concern.

  • Reliable Earthing—Reliable earthing of rack-mounted equipment should be maintained. Particular attention should be given to supply connections other than direct connections to the branch circuit (e.g., use of power strips).

  • Please note that the handlebar and mounting ear must be installed after the slide rail kit has been installed completely.

The appliance requires both InfiniBand and Ethernet (out-of band management) connectivity where eth0 should be connected to a management network switch, and both InfiniBand ports should be connected to InfiniBand switches. They can be connected to the same switch, but NVIDIA recommends connecting to two separate switches to ensure SM connectivity to the fabric.

Check to determine if your local or national electrical codes require an external ground to all IT components. If so, connect a ground wire to one of the casing screws and connect the other end to a valid ground. If you choose not to use the ground screw, make sure that the rack is properly grounded and that there is a valid ground connection between the chassis of the appliance and the rack. Test the ground using an Ohm meter.

Warning

Some national and/or local codes may require IT components to be bonded and externally grounded (not including the power cord ground). You must follow all national and local codes when installing this equipment.

The system is shipped with two power supply units. Each unit has a separate AC receptacle. The system accepts input voltages of 100 - 127 VAC and 200 - 240 VAC for all possible PS units. The power cords should be standard 3-wire AC power cords including a safety ground and rated for 15A or higher. The power supplies deliver 750W AC.

Warning

After inserting a power cable and turning the appliance on, confirm that the green system status LED light is on.

Warning

When turning off the system, make sure both connector LEDs are off to ensure a powered down status.

Important

Do not hot swap the power supply if your appliance has only one power supply. You must power down the system to replace the power supply unit there is only one PS unit in the appliance.

Extracting and Inserting the Power Supply Unit

Two Power Inlets - Electric Caution Notifications

fig21.png

Warning

The power supply is only hot-swappable if you have a redundant system with two power supplies installed. If you only have one power supply installed, before removing or replacing the power supply, you must first:

  1. Make sure the system is out of service.

  2. Turn off all peripheral devices connected to the system.

  3. Turn the system off by pressing the power button.

  4. Unplug the AC power cord from the system or wall outlet.

To replace the power supply, follow these steps:

  1. Disconnect the power cable from the power outlet and from the PSU you intend to remove.

  2. Remove the cable from the strap on the PSU handle.

  3. Unlatch and lift the optional cable management arm if it interferes with the PSU removal.

  4. Press and hold the PSU latch while sliding the PSU out:

    removing-psu.png

  5. Slide the new PSU in:

    installing-psu.png

  6. If you have unlatched the cable management arm, re-latch it.

  7. Connect the power cable to the PSU and plug the cable into a power outlet.

    Important

    When connecting the power cable to the PSU, secure the cable to the PSU with the strap.

    Warning

    When installing, hot swapping or hot adding a new PSU, wait 15 seconds for the system to recognize the PSU and determine its status. PSU redundancy may not occur until discovery is complete. The PSU status indicator turns green to indicate that the PSU is functioning properly.

Warning

Do not run the system with openings of missing parts. This may cause overheating due to improper air flow.

Important

Never pull out a working hard drive while the appliance is turned on. You can safely pull out a faulty hard drive indicated by a solid amber light.

If one SSD physically fails, the appliance keeps working thanks to RAID mirroring. You can pull out and replace a faulty drive with a new blank SSD. The blank SSD will synchronize with the other SSD. This takes up to 48 hours but does not interrupt appliance operation.

  1. Power down the appliance before removing the SSD

  2. Press the release button to open the drive carrier release handle.

  3. Holding the drive carrier release handle, slide the drive carrier out of the drive slot.

  4. Remove the SSD from its carrier drawer.

    removing-drive-3.png

  5. Hold the release handle and slide the drive carrier into the drive slot.

  6. Close the drive carrier release handle to lock the drive in place.

    installing-drive-3.png

  7. Power on the appliance.

Warning

The SW RAID mechanism will identify that a new SSD was inserted and synchronize the data with the second SSD, this process might take up to 48 hours to complete.

To disassemble the appliance from the rack:

  1. Shut down the system.

  2. Unplug and remove all connectors.

  3. Unplug all power cords.

  4. Remove the ground wire.

  5. Unscrew the 2 center bolts from inside the handles.

  6. Slide the appliance from the rack.

  7. Remove the rail slides from the rack.

Warning

NVIDIA does not support battery replacement. Customer removal of the cover will void the warranty. Remove the cover only to comply with WEEE directives or to disassemble the appliance for environmentally approved disposal.

This procedure is only to be used when you are disassembling this appliance before discarding, to comply with regulations regarding disposal of batteries.

  1. Remove the cover.

  2. Remove the battery and dispose of it according to local, state and federal regulations.

Warning

image2020-11-23_0-11-0.png

According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE) should be collected separately and not disposed of with regular household waste. Dispose of this product and all of its parts in a responsible and environmentally friendly way.

Power Cable

The NVIDIA MetroX-3 XC appliance is shipped with two power supply units. Each unit has a separate AC receptacle. The appliance accepts voltages of 100-127 VAC and 200-240 VAC for all possible power supply units. The power cords should be a standard 3-wire AC power cards, including a safety ground, and rated for 15A or higher. The power supplies deliver 2KW AC.

Important

After inserting a power cable and turning the appliance on, confirm the green system LED light is on.

Important

Do not hot swap the power supply if your appliance has only one power supply. Instead, power down the system to replace the power supply unit.


ConnectX-7 Networking Cards Cables

Networking Cable Installation

All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated.

  1. Support the weight of the cable before connecting the cable to the adapter card. Do this by using a cable holder or tying the cable to the rack.

  2. Determine the correct orientation of the connector to the card before inserting the connector. Do not try and insert the connector upside down. This may damage the adapter card.

  3. Insert the connector into the adapter card. Be careful to insert the connector straight into the cage. Do not apply any torque, up or down, to the connector cage in the adapter card.

  4. Make sure that the connector locks in place.

Warning

When installing cables, make sure that the latches engage.

Important

Always install and remove cables by pushing or pulling the cable and connector in a straight line with the card.

  1. After inserting a cable into a port, the green LED indicator will light when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port). See Network Interface Cards LEDs under the Interfaces section.

  2. After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When data is being transferred, the green LED will blink.

  3. Care should be taken to not impede the air exhaust flow through the ventilation holes. Use cable lengths that allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack.

  4. To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator will turn off when the cable is unseated.

All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The LED indicator, corresponding to each data port, will light up when the physical connection is established. When a logical connection is made, the relevant port LED will turn on. To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator for that port will turn off when the cable is unseated. For full cabling guidelines, ask your NVIDIA Networking representative for a copy of NVIDIA Cable Management Guidelines and FAQs Application Note.

Important

Do not force the cable into the cage with more than 40 newtons/9.0 pounds/4kg of force. Greater insertion force may cause damage to the cable or to the cage.


The system’s input voltage is specified in the Technical Specifications chapter. The power cords should be a standard 3-wire AC power cords including a safety ground and rated for 15A or higher.

Important

The system platform will automatically power on when AC power is applied. There is no power system. Check all boards, power supplies and fans for proper insertion before plugging in a power cable.

Step 1. Plug in the first power cable.

Step 2. Plug in the second power cable.

Step 3. Wait for the System Status LED to turn green.

Important

It may take up to five minutes to turn on the system. If the System Status LED is red after five minutes, unplug the system and call your NVIDIA Networking representative for assistance.

Step 4. Check the System Status LEDs and confirm that all of the LEDs show status lights consistent with normal operation (initially flashing, and then moving to a steady color). For more information, refer to System Monitoring.

Important

After inserting a power cable and confirming the green System Status LED light is on, make sure that the Fan Status LED is green. If the Fan Status LED is not green, unplug the power connection, and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and/or obstacles. If no obstacles were found and the problem persists, call your NVIDIA Networking representative for assistance.

© Copyright 2023, NVIDIA. Last updated on Sep 3, 2023.