Hardware Installation

NVIDIA BlueField-2 InfiniBand_Ethernet DPU User Guide

Installation and initialization of the DPU require attention to the mechanical attributes, power specification, and precautions for electronic equipment.

Note

Safety warnings are provided here in the English language.

Please observe all safety warnings to avoid injury and prevent damage to system components. Note that not all warnings are relevant to all models.

Note that not all warnings are relevant to all models.

image2021-8-11_8-44-35.png

General Installation Instructions

Read all installation instructions before connecting the equipment to the power source.

image2021-8-11_8-56-28.png

Jewelry Removal Warning

Before you install or remove equipment that is connected to power lines, remove jewelry such as bracelets, necklaces, rings, watches, and so on. Metal objects heat up when connected to power and ground and can meltdown, causing serious burns and/or welding the metal object to the terminals.

image2021-8-11_8-44-35.png

Over-temperature

This equipment should not be operated in an area with an ambient temperature exceed­ing the maximum recommended: 55°C (131°F). An airflow of 200LFM at this maximum ambient temperature is required for HCA cards and NICs. To guarantee proper airflow, allow at least 8cm (3 inches) of clearance around the ventila­tion openings.

image2021-8-11_8-56-28.png

During Lightning - Electrical Hazard

During periods of lightning activity, do not work on the equipment or connect or dis­connect cables.

image2021-8-11_8-44-35.png

Copper Cable Connecting/Disconnecting

Some copper cables are heavy and not flexible, as such, they should be carefully attached to or detached from the connectors. Refer to the cable manufacturer for spe­cial warnings and instructions.

image2021-8-11_8-56-28.png

Equipment Installation

This equipment should be installed, replaced, or serviced only by trained and qualified personnel.

image2021-8-11_8-44-35.png

Equipment Disposal

The disposal of this equipment should be in accordance to all national laws and regula­tions.

image2021-8-11_8-56-28.png

Local and National Electrical Codes

This equipment should be installed in compliance with local and national electrical codes.

image2021-8-11_8-44-3.png

Hazardous Radiation Exposure

  • Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure.For products with optical ports.

  • CLASS 1 LASER PRODUCT and reference to the most recent laser standards:
    IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:20

The installation procedure of DPU involves the following steps:

Step

Procedure

Direct Link

1

Check the system’s requirements.

Refer to System Requirements

2

Pay attention to the airflow consideration within the host system

Refer to Airflow Requirements

3

Follow the safety precautions

Refer to Safety Precautions

4

Unpack the package

Refer to Unpacking

5

Follow the pre-installation checklist

Refer to Pre-Installation Checklist

7

Install the DPU according to the form factor you have purchased.

Refer to Cards Installation

8

Connect cables or modules to the card

Refer to Cables and Modules Installation

Hardware Requirements

Important

Unless otherwise specified, products are designed to work in an environmentally controlled data center with low levels of gaseous and dust (particulate) contamination.

The operating environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness level.

Important

The BlueField-2 DPU is designed and validated for operation in data-center servers and other large environments that guarantee proper power supply and airflow conditions.

The DPU is not intended for installation on a desktop or a workstation. Moreover, installing the DPU in any system without proper power and airflow levels can impact the DPU's functionality and potentially damage it. Failure to meet the environmental requirements listed in this user manual may void the warranty.

The below table lists the motherboard and power supply requirements per card form factor.

HHHL DPUs

E-Series: A maximum of 75W system power supply through the PCIe x16 interface (Relevant for MBF2M345A-HECOT and MBF2M345A-HESOT)

FHHL DPUs

E-Series: A maximum of 75W system power supply through the PCIe x16 interface (Relevant for MBF2M516A-EECOT, MBF2M516A-EEEOT, MBF2M516A-EENOT, MBF2M516C-EECOT and MBF2M516C-EESOT )

P-Series: Minimum 75W or greater system power supply through the PCIe x16 interface and an additional 75W through the supplementary 6-pin ATX power supply connector (Relevant for OPNs: MBF2H516A-EEEOT
MBF2H516A-EENOT, MBF2H516C-EECOT and MBF2H516C-EESOT).

Airflow Requirements

DPU is offered with one airflow pattern: from the heatsink to the network ports.

Important

It is prohibited to use port-to-heatsink airflow as it may cause damage to the DPU.

Please refer to the Specifications section for airflow numbers per card model.

Software Requirements

  • See Operating Systems/Distributions section under the Introduction section.

  • Software Stacks - The DPU is shipped with Linux based Operating System burned on it which includes all needed drivers. For more information, please refer to the Software User Manual.

The DPU being installed in a system that operates with voltages that can be lethal. Before opening the case of the system, observe the following precautions to avoid injury and prevent damage to system components.

  • Remove any metallic objects from your hands and wrists.

  • Make sure to use only insulated tools.

  • Verify that the system is powered off and is unplugged.

  • It is strongly recommended to use an ESD strap or other antistatic devices.

Check against the package contents list that all the parts have been sent. Check the parts for visible damage that may have occurred during shipping. Please note that the cards must be placed on an antistatic surface.

Important

Please note that if the card is removed hastily from the antistatic bag, the plastic ziplock may harm the EMI fingers on the networking connector. Carefully remove the card from the antistatic bag to avoid damaging the EMI fingers.

For package contents, please refer to Package Contents.

  1. Verify that your system meets the hardware and software requirements stated above.

  2. Shut down your system if active.

    Turn off the power to the system, and disconnect the power cord. Refer to the system documentation for instructions. Before you install the DPU, make sure that the system is disconnected from power.

This section provides detailed instructions on installing your DPU in a system.

Warning

Please note that the following figures are for illustration purposes only.

Important

To power up the FHHL P-Series DPUs , you need to connect a PCIe external power cable. The PCIe external power cable should be supplied by the customer. Refer to External Power Supply Connector for pin descriptions.

  1. Open the system case.

  2. Place the DPU in an available PCI Express slot.

    image2020-10-15_17-11-25.png

  3. Applying even pressure at both corners of the card, insert the DPU into the PCI Express slot until firmly seated.

    Important

    Do not use excessive force when seating the card, as this may damage the system or the DPU.

    image2020-10-15_17-17-1.png

  4. When the DPU is properly seated, the port connectors are aligned with the slot opening, and the DPU faceplate is visible against the system chassis.

    image2020-10-15_17-17-27.png

  5. Secure the DPU with the screw.

    image2020-10-15_17-18-53.png

  6. For the FHHL 100Gb/s P-Series DPUs, install the PCIe external power cable. Connect the 6-pin power connector from the power supply to the power connector on the top edge of the DPU. Note that the connector and socket on the graphics card have a unique shape and connect one way only.
    For further instructions, please refer to the cable vendor documentation. Please refer to the pinout description in External Power Supply Connector Pins .

  7. Close the system case.

  8. Install the networking cables. For instructions, please refer to Networking Cable Installation.

Note

To uninstall the DPU card, see Uninstall DPU.

Networking Cable Installation

  1. All cables can be inserted or removed with the unit powered on.

  2. To insert a cable, press the connector into the port receptacle until the connector is firmly seated.

    1. Support the weight of the cable before connecting the cable to the DPU card. Do this by using a cable holder or tying the cable to the rack.

    2. Determine the correct orientation of the connector to the card before inserting the connector. Do not try and insert the connector upside down. This may damage the DPU card.

    3. Insert the connector into the DPU card. Be careful to insert the connector straight into the cage. Do not apply any torque, up or down, to the connector cage in the DPU card.

    4. Make sure that the connector locks in place.

      Warning

      When installing cables make sure that the latches engage.

      Important

      Always install and remove cables by pushing or pulling the cable and connector in a straight line with the card.

  3. After inserting a cable into a port, the Green LED indicator will light when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port). See Networking Ports LEDs interface under the Supported Interfaces section.

  4. After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When data is being transferred the Green LED will blink.

  5. Make sure not to impede the air exhaust flow through the ventilation holes. Use cable lengths that allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack.

  6. To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator will turn off when the cable is unseated.

UART Cable Installation

A UART console interface is located on the DPU. Connect the supplied USB 2.0 Type-A to a 30pin Flat Socket cable from this interface to a motherboard/desired server for UART console capabilities. For more information on the NC-SI interface, please refer to UART Interface Connectivity.

Important

The USB 2.0 Type-A to 30pin Flat Socket cable is intended for internal system use and is sensitive to excessive pulling force and crushing forces. Therefore, proper care must be taken during the installation procedure. The best practice is to install the cable properly the first time around carefully .

Important

Once a cable is plugged into the UART interface, its other side must be plugged into a USB connector. Leaving the USB side unconnected might lead to unexpected behavior of the DPU card.

  1. Make sure the system is powered off.

  2. Determine the correct orientation of the UART connector on the card before inserting the cable. Pay attention to the UART cable key as it should guide you to the corresponding mating connector orientation on the board interface.

    image2021-10-27_13-13-45.png

  3. Carefully connect the 30 pin connector on the board to the mating cable.

  4. Connect the USB cable to the desired interface master, which can be a motherboard or any desired server. Do not leave the USB side unattended.

Safety Precautions

The DPU is installed in a system that operates with voltages that can be lethal. Before uninstalling the DPU, please observe the following precautions to avoid injury and prevent damage to system components.

  1. Remove any metallic objects from your hands and wrists.

  2. It is strongly recommended to use an ESD strap or other antistatic devices.

  3. Turn off the system and disconnect the power cord from the server.

Card Removal

Please note that the following images are for illustration purposes only.

  1. Verify that the system is powered off and unplugged.

  2. Wait 30 seconds.

  3. To remove the card, disengage the retention mechanism on the bracket (screws).

  4. Holding the DPU from its center, gently pull the DPU out of the PCI Express slot.

  5. When the port connectors reach the top of the chassis window, gently pull the DPU in parallel to the motherboard.

© Copyright 2023, NVIDIA. Last updated on Sep 8, 2023.