I/O Tray Removal and Installation

I/O Tray Replacement Overview

This is a high-level overview of the procedure to replace the I/O tray on the DGX-2 System.
  1. Get a replacement I/O tray from NVIDIA Enterprise Support.
  2. Shut down the system.
  3. Label all I/O tray cables and unplug them.
  4. Remove the I/O tray, place on a solid, flat surface, and then open the lid.
  5. Remove all ConnectX-5 cards by removing the screw that attaches the card and then removing the card.
  6. Install all the ConnectX-5 cards into the new I/O tray.
  7. Close the lid on the I/O tray, then insert the tray into the system.
  8. Plug in all cables using the labels as a reference.
  9. Power on the system.
  10. Verify that all ConnectX-5 cards are healthy and accessible using nvsm health.

Replacing the I/O Tray

CAUTION: Static Sensitive Devices: - Be sure to observe best practices for electrostatic discharge (ESD) protection. This includes making sure personnel and equipment are connected to a common ground, such as by wearing a wrist strap connected to the chassis ground, and placing components on static-free work surfaces.

  1. Power down the system.
  2. Label all the network ports (0-7) connected to the I/O tray for easy identification when reconnecting.

  3. Remove the cables.
  4. Remove the I/O tray.
    1. Loosen the two green I/O tray screws with a Philips #2 screwdriver and pull the levers outward to release the tray.

    2. Pull the I/O tray out of the system and place it on a solid, flat work surface.
      Exercise care when removing the tray as it is long and heavy, and do not handle the module from the rear connectors.
  5. Remove the I/O tray lid.
    1. Loosen the black screws and then push the lid towards you to release the lid.

    2. Lift the lid upward.

  6. Move all the ConnectX-5 cards from the old tray to the new tray. Perform the following for each card.
    1. Remove the screw that secures the card, then pull the card out of the slot.

    2. Insert the card into the new I/O tray and secure with the screw removed from the previous step.
  7. Install the I/O tray.
    1. Replace the I/O tray lid by placing it over the module using the guiding pins and grooves.

    2. Slide the lid back so that the black screws enage with the tray, then tighten the black screws to secure the lid.

    3. Push the I/O tray back into the system.

    4. Close the levers toward the center, making sure the connectors engage with the midplane, then tighten the thumbscrews by hand or with a Phillips #2 screwdriver.

  8. Confirm the I/O tray replacement.
    1. Connect all cables back into the ConnectX-5 card ports.
    2. Power on the system and log in.
    3. Confirm that the system is healthy.
      $ sudo nvsm show health
      There should be no new alerts listed.
  9. Return the old I/O tray using the packaging from the new tray.