CS7500 648-Port EDR InfiniBand Switch-IB™ Series Switch Platform Hardware User Manual (EOL)

Unpacking and Physical Installation

The crate has a shock sticker applied. When receiving the create, look for and inspect the shock sticker to confirm that it has not triggered.

Tip

IMPORTANT NOTE: The shock sticker does not necessarily indicate damage to the contents. However, be sure to carefully inspect the contents of a crate with a triggered sticker.

The shock stickers turn red if the create has been mishandled or handled roughly. If one of the shock stickers is red, notify the shipper and Mellanox.

Shock Stickers

image2018-11-28_17-27-22.png

Before starting the procedure, put the ESD strap on and connect it to a valid ground.

  • Unscrew and remove the top cover of the crate.

  • Unscrew and remove the sides of the crate.

    Tip

    It is highly recommended to have a screw gun or electric screwdriver for this step.

Crate Screws

image2018-11-28_18-16-14.png

  • Remove the nylon covers from the chassis.

  • Visually inspect the chassis, make sure that:

  • There is no visible damage

  • 10 PSUs are installed

  • Remove all protective plastic film from the sides and top of the chassis.

Note

Unpack the system and check against the parts list to make sure that all the parts have been sent. Check the parts for visible damage that may have occurred during shipping. If anything is damaged or missing, contact your customer representative immediately.

Important

Do not remove any of the blocks or the lock-down bars at this time.

Note

The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Guarantee proper ventilation, by leaving 8cm (3”) of space to the front and rear of the switch. This ensures proper airflow through the chassis. This is crucial for maintaining good airflow at ambient temperature. In particular, route cables such that they do not impede the air into or out of the chassis.

Important

Warning: This equipment is very heavy. Make sure that adequate manpower and proper equipment is used for transporting and moving the chassis. Before attempting to move and place the chassis make sure that it is empty of all leafs, spines and management modules and to use a mechanical lift.

This chassis can be installed in standard 19” racks that have 715-850mm between the vertical supports of the rack.

Distance Between the Vertical Supports

image2018-11-28_18-19-17.png

The vertical supports may have to be moved so that the vertical support closest to the door is a minimum of 6cm from the inside of the door. This is required so that the shelf does not hit the door.

Note

If you move the vertical supports make sure that you reinstall them vertically plumb.

The switch platform uses 29U of rack space, 28U for the chassis and 1U for the shelf. The switch ships from the factory with mounting holes on the spine side. There are upper brackets to connect the leaf side to the rack near the top of the chassis, and there are two lock-down bars to secure the chassis to the shelf. The weight of the switch is supported from underneath the unit by the shelf.

Tip

Due to the space required by up to 648 connector cables, it is recommended to use a rack that is 120cm long and 80cm wide. This should allow for proper cable management and enough ventilation to properly cool the chassis.

Before starting any procedure on the switch system:

Put an ESD preventive wrist strap on your wrist, and make sure there is good contact between your body and the strap.

Plug the other end of the wrist strap to a valid ground. Make sure that this is a tight fit.

Important

You may need a mechanical lift to move and insert the chassis into the rack.

Tip

It is recommended to use an AWG6 or 4mm diameter wire for grounding purposes.

Installation Kit Parts

Chassis Installation Kit Items

Item No.

Quantity

Description

Item No.

Quantity

Description

1

1

Shelf assembly

10

8

M6X16 hex-head screw

2

1

Riveted right chassis slide

11

26

M6 spring washer

3

1

Riveted left chassis slide

12

8

M6 flat washer

4

2

Support bracket

13

1

Weld bracket

5

8

M5 spring washer

14

12

10-32 hex-head screw

6

8

M5 pan-head screw

15

12

Spring washer #10

7

12

M6X16 pan-head screw

16

18

M6X25 pan head screw

8

30

M6 cage nut

17

4

Shelf arm bracket

9

2

Perforated fixing bracket

18

12

Washer #10

Chassis Installation Kit

image2018-12-2_16-1-51.png


Cable Management Installation Kit

Cable Management Installation Kit Parts

Item No.3

Quantity

Description

Item No.

Quantity

Description

1

1

Left riveted cable holder

3

14

Pan-head screw

2

1

Right riveted cable holder

4

14

M6 cage nut

Cable Management Installation

image2018-12-2_16-2-30.png


Shelf Installation Kit

The shelf installation kit includes 18 shelves only.

Shelf Installation Kit

image2018-12-2_16-2-57.png


Required Installation Tools

Shown below are the tools which are required for the installation of the director switch chassis.

Tools for Installation

image2018-11-28_18-25-57.png


Note

Some of the steps that follow are accompanied by figures that illustrate the installation of the switch system chassis. For the purpose of clarity, the racks in those figures will have the side panels removed. You, however, do not need to remove the side panels to install the switch chassis.

Tip

It is recommended to have at least three people for the duration of the installation procedure. Use a mechanical lift to raise this chassis. If not, use enough manpower to ensure the safety and well-being of all of the people involved in the installation.

Step 1. Insert 3 M6 cage nuts each from the inside of BEAM-1 and BEAM-2 on the spine side in order to support the shelf.

Tip

It is recommended to set the shelf at U3 since the chassis would roll off more easily on it from the pallet.

Cage Nut Placement for Shelf on BEAM-1 and BEAM-2

image2018-12-2_16-3-58.png

Step 2. Insert 6 M6 cage nuts from the inside each of BEAM-3 and BEAM-4 on the leaf side in order to support the shelf.

Cage Nut Placement for Shelf on BEAM-3 and BEAM-4

image2018-12-2_16-4-18.png

Step 3. Place the top end of the support bracket at the top of U4 using 2 M6x25 screws and 2 M6 flat washers on BEAM-3 and BEAM-4.

Cage Nut Placement for Support Bracket

image2018-12-2_16-7-35.png

Step 4. Insert 6 M6 cage nuts (from the Chassis Installation Kit Items box) on the inside of each of the spine side beams of the rack in the slots indicated in the figure below.

Note

The indexes in the figure below count from the first rack hole above the shelf.

Cage Nut Placement for Switch System Chassis on Spine Side

image2020-2-27_10-30-55.png

Step 5. Insert 6 M6 cage nuts (from the Cable Management Installation Kit Parts box) on the inside of each of the leaf side beams of the rack in the slots indicated in the figure below.

Note

The indexes in the figure below count from the first rack hole above the shelf.

Cage Nut Placement for Cable Holders on Leaf Side

image2020-2-27_10-32-10.png

Step 6. Using a ratchet wrench, loosen the shelf arms’ M6 hex screws enough to allow for slight movement.

Loosening the Leaf-Side Shelf Arms

image2018-11-28_17-59-53.png

Step 7. Adjust the shelf’s leaf-side arms so that the distance between the leaf-side and spine-side arms is at least 5mm longer than the distance between the rack beams.

Adjusting the Leaf-Side Shelf Arms

image2018-11-28_17-59-11.png

Step 8. Place the shelf in U3 of the rack by inserting it at a tilt.

Note

At least 2 people are necessary for installing the shelf.

Placing Shelf

image2018-12-2_16-10-49.png

Step 9. Assemble the spine-side M6X25 pan-head screws and the arm brackets at an intermediate 3Nm torque.

Tightening Shelf Cage Nut Screws on Spine Side

image2018-12-2_16-15-55.png

Step 10. Assemble the leaf-side M6X25 pan-head screws and the arm brackets at 3Nm torque.

Tightening Shelf Cage Nut Screws on Leaf Side

image2018-12-2_16-17-17.png

Step 11. Tighten the M6X25 pan-head screws of the shelf arms on the spine side at 9Nm torque.

Tightening Spine-side Shelf Arm Screws

image2018-11-28_17-57-40.png

Step 12. Screw in 4 more M6X25 pan-head screws in the support brackets as fasteners from the leaf side at 3Nm torque.

Screwing Leaf-side Fasteners

image2018-12-2_16-19-7.png

Step 13. Tighten the 10 hex head screws of the shelf’s leaf-side arms at 9Nm torque on both sides.

Tightening Spine-side Shelf Arm Screws

image2018-11-28_17-57-17.png

Step 14. Tighten the 12 M6X25 pan-head screws of the shelf’s leaf-side arms at 9Nm torque now that the shelf has been placed.

Tightening Leaf-side Shelf Screws

image2018-12-2_16-20-25.png

Step 15. Assemble the bracket weld to the shelf on the spine side and tighten at 5Nm with 2 hex screws, 2 spring washers and 2 flat washers.

Weld Bracket Assembly

image2018-11-28_17-56-12.png

Step 16. Before placing the chassis in the rack, make sure to leave more room on the leaf (port cables) side to allow room for cable management.

Placement of Chassis in Rack - Top View

image2018-11-28_17-55-49.png

Step 17. Put the crate on the fork lift or a mechanical lift.

Note

From Steps 17-23, three people should participate in the installation process.

Mechanical Lift

image2018-11-28_17-52-58.png

Fork Lift

image2018-11-28_17-53-5.png

Step 18. Position the chassis in front of the installation rack.

Step 19. Unscrew both lock-down bars.

Important

The chassis is on ball bearings and can roll easily. Beware that the chassis can roll off of the pallet possibly causing grave bodily harm should it fall on someone.

Step 20. Using a fork or mechanical lift, position the middle of the leaf-side of the chassis in front of the spine-side of the rack.

Rack and Chassis Alignment

image2018-11-28_17-50-49.png

Step 21. Place the rotated strip on top of the bracket weld.

Rotated Strip and Bracket Weld

image2018-11-28_17-50-17.png

Step 22. Unscrew the lock-down bar facing the rack.

Important

Note that the chassis is on ball bearings, and with the lock-down bars removed, the chassis can roll off!

Step 23. Slide the switch system chassis halfway into the rack.

Important

Push only from the spine side so as to not injure your fingers during insertion.

Sliding Chassis in Rack

image2018-12-2_16-21-55.png

Step 24. Slide the switch system chassis all the way into the rack until it stops.

Important

Beware not to injure your fingers during insertion.

Step 25. Slide in the left and right chassis slides from the leaf side.

Sliding in Chassis Slides

image2018-12-2_16-22-17.png

Step 26. Slide the switch system chassis all the way into the rack.

Sliding Chassis into Rack

image2018-12-2_16-22-32.png

Step 27. Screw the chassis to the rack on the spine side using 12 M6X16 screws where the cage nuts have been placed at 9Nm torque.

Screwing the Chassis to the Rack

image2018-12-2_16-23-0.png

Step 28. Assemble the 2 4-oval washer plates to the left and right chassis slides on the leaf side at 3.23-3.58Nm torque using 4 M5 pan-head screws on each side.

Screwing the 4-Oval Washer Plates

image2018-12-2_16-23-17.png

Step 29. Remove the M6X16 screws holding the weld bracket on the spine side using a ratchet wrench.

Removing the Weld Bracket

image2018-11-28_17-37-53.png

Step 30. Place the perforated fixing bracket on the shelf from the leaf side and assemble it using a ratchet wrench (with 8mm socket) and 6 10-32 hex screws, 6 #10 flat washers, and 6 #10 spring washers to the chassis at 3.23-3.58Nm torque.

Leaf Side Fixing Bracket With Chassis

image2018-12-2_16-25-17.png

Step 31. Place the perforated fixing bracket on the shelf from the spine side and assemble it using 6 10-32 hex screws, 6 #10 spring washers, and 6 #10 flat washers to the chassis at 3.23-3.58Nm torque.

Spine Side Fixing Bracket with Chassis

image2018-12-2_16-25-32.png

Step 32. Screw the perforated fixing bracket on the leaf side to the shelf at 9Nm torque.

Leaf Side Fixing Bracket with Shelf

image2018-12-2_16-25-47.png

Step 33. Screw the fixing bracket on the spine side to the shelf using 3 M6X16 hex screws, 3 M6 spring washers, and 3 M6 flat washers at 9Nm torque.

Spine Side Fixing Bracket With Shelf

image2018-12-2_16-26-0.png

Step 34. Assemble the cable holders to the leaf-side rack using 14 M6X16 pan-head screws at 9Nm torque.

Installing Cable Holders

image2018-12-2_16-26-53.png

Item No.

Quantity

Description

Item No.

Quantity

Description

© Copyright 2023, NVIDIA. Last updated on Oct 9, 2023.