Adding the Optional Dual-port Horizontal Network Card

The DGX A100 comes with a vertical dual-port network card. You can expand the ports by adding a horizontal dual-port network card for slot 5.

Dual-port Network Card Upgrade Overview

This is a high-level overview of the procedure to install the optional horizontal dual-port network card on the DGX A100 system.

  1. Obtain the new card from NVIDIA Sales.

  2. Shut down the system.

  3. Label all motherboard tray cables and unplug them.

  4. Slide out the motherboard tray until it locks and then open the lid.

  5. Remove the PCI slot filler for slot 5.

  6. Insert the new card into the slot and secure with the screw.

  7. Close the lid on the motherboard tray, then insert the tray into the system.

  8. Plug in all cables using the labels as a reference.

  9. Power on the system.

  10. Verify that the network card is healthy using nvsm show health.

Adding the Horizontal Network Card

Be sure you have obtained the horizontal dual-port network card.

Caution

Static Sensitive Devices: - Be sure to observe best practices for electrostatic discharge (ESD) protection. This includes making sure personnel and equipment are connected to a common ground, such as by wearing a wrist strap connected to the chassis ground, and placing components on static-free work surfaces.

  1. Power down the system.

  2. Label all network, monitor, and USB cables connected to the motherboard tray for easy identification when reconnecting.

  3. Unplug all power cords, and all network, monitor, and USB cables.

  4. Remove the motherboard tray.

    Refer to the instructions in the section Accessing the Motherboard Tray.

  5. Unlock the PCI EMI shield.

    1. Loosen the black thumbscrew that secures the locking mechanism in place.

      _images/network-card-add1.png
    2. Open the locking mechanism by turning 90 degrees or more.

      _images/network-card-add2.png
  6. Remove the EMI shield.

    Slide the EMI shield to the left to release it from the PCI slot on the riser card.

    _images/network-card-add3.png
  7. Install the new network card, inserting it into the slot on the riser card.

    _images/network-card-add4.png
    _images/network-card-horiz-replace3.png
  8. Lock the network card in place.

    1. Close the locking mechanism by turning it back into its slot.

      _images/network-card-lock1.png
    2. Tighten the black thumb screw to secure the card in place.

      _images/network-card-lock2.png
  9. Install the motherboard tray lid and then install the motherboard tray.

    Refer to the instructions in the section Replacing the Motherboard Tray.

  10. Connect all cables back into the network card ports.

  11. Power on the system and log in.

  12. Confirm that the system is healthy.

    $ sudo nvsm show health
    

    There should be no new alerts listed.

Verify that the firmware is up to date according to the instructions in Updating the Mellanox Network Card Firmware.