NVIDIA UFM Cyber-AI Documentation v2.7.0
NVIDIA UFM Cyber-AI Documentation v2.7.0

Appendix - Cyber-AI Appliance OS Remanufacture

Important

This section provides a step-by-step guide for deploying Cyber-AI (CAI) from an ISO file in case of unrecoverable issues. This guide provides instructions on how to remanufacture the Cyber-AI appliance and OS.

Run the following command to extract the ufm-cyberai-appliance-<version>-omu.tar to a temporary directory:

Copy
Copied!
            

tar xzf /path/to/ufm-cyberai-appliance-<version>-omu.tar -C /tmp

An ISO file and an upgrade script will be present inside the directory.

Copy
Copied!
            

ls -ltrh /tmp/ufm-cyberai-appliance-<version>-omu/ -rw-r--r-- 1 root root 7.5G Dec 31 17:49 ufm-cyberai-appliance-<version>.iso -rwxr-xr-x 1 root root 11K Dec 31 17:49 ufm-os-upgrade.sh

Burning ISO can be performed on Windows or Linux operating systems. Based on the desired installation method, follow the below instructions.

Windows

  1. Download and open Rufus. Refer to Rufus - Create bootable USB drives the easy way.

  2. Download and open the tar file ufm-cyberai-appliance-<version>-omu.tar.

  3. On Rufus, click on "SELECT" and from the drop-down menu, select the ufm-cyberai-appliance-<version>.iso, then click "START".

    cai_iso17-version-1-modificationdate-1672660123947-api-v2.JPG

  4. An "isohybrid image detected" message will pop up. Choose "Write in DD mode" and click "OK".

    image2023-1-2_13-51-24-version-1-modificationdate-1672660284177-api-v2.png

  5. A message will appear stating that all data on the usb device will be lost, click "OK and continue".

    image2023-1-2_13-52-44-version-1-modificationdate-1672660364030-api-v2.png

  6. Wait for Rufus to finish.

  7. Unplug the USB device.

Linux

  1. Identify the USB drive by running the following command:

    Important

    IMPORTANT!!! Ensure you are NOT running the following commands on a hard drive device but only on the USB (in the examples below it will be /dev/sdb).

    Warning

    The USB drive is mapped to sdb in the following command snippet.

    Copy
    Copied!
                

    root@ubuntu18:~# ls -ltrh /dev/disk/by-id/usb* lrwxrwxrwx 1 root root 9 Jan 2 13:44 /dev/disk/by-id/usb-SanDisk_Cruzer_Glide_3.0_4C530000040724111091-0:0 -> ../../sdb lrwxrwxrwx 1 root root 10 Jan 2 13:44 /dev/disk/by-id/usb-SanDisk_Cruzer_Glide_3.0_4C530000040724111091-0:0-part1 -> ../../sdb1

  2. Copy the ufm-cyberai-appliance-<version>.iso to the USB using the following dd command:

    Warning

    The USB drive is mapped to /dev/sdb.

    Copy
    Copied!
                

    dd if=/path/to/ufm-cyberai-appliance-<version>.iso of=/dev/sdb bs=4M status=progress oflag=sync

  3. Verify that the USB is bootable:

    Copy
    Copied!
                

    root@ubuntu18:~# fdisk -l /dev/sdb Disk /dev/sdb: 14.9 GiB, 16005464064 bytes, 31260672 sectors Units: sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disklabel type: dos Disk identifier: 0x594ec03e   Device Boot Start End Sectors Size Id Type /dev/sdb1 * 64 15679439 15679376 7.5G 17 Hidden HPFS/NTFS

  4. Unplug the USB.

  1. Plug the USB (prepared in the previous step) to one of the Cyber-AI server back USB ports.

  2. Login to BMC web UI: https://<BMC_IP_ADDRESS>.

  3. Navigate to "Remote Control" → "Server Power Control" and check the "Force-enter BIOS Setup" checkbox under the "Restart Server". Then, click "Perform Action".

    image2023-1-2_19-11-54-version-1-modificationdate-1672679513460-api-v2.png

  4. Navigate to "Remote Control" → "iKVM over HTML5" and click "Launch iKVM over HTML5" button.

    image2023-1-2_19-13-0-version-1-modificationdate-1672679579413-api-v2.png

    A new window will open.

  5. In the BIOS menu, navigate to BOOT → "Boot Option #1" and check "USB Device:<NAME OF USB DEVICE>".

    image2023-1-2_19-16-7-version-1-modificationdate-1672679766743-api-v2.png

    image2023-1-2_19-15-38-version-1-modificationdate-1672679740673-api-v2.png

  6. Navigate to "Save & Exit" → "Save Changes and Reset" and press enter.

    image2023-1-2_19-17-20-version-1-modificationdate-1672679839830-api-v2.png

  7. At this point Cyber-AI installation should start automatically.

    image2023-1-2_19-19-47-version-1-modificationdate-1672679986550-api-v2.png

  8. The process takes ~50 minutes, "Running preseed..." will show ~14-16 percent and will remain on this percentage for most of the time. This does not mean that the process is stuck.
    The preseed file runs in the background and will take ~35-40 minutes to complete.
    a log can be viewed by switching to tty4 by click on "Virtual Media" → "Virtual Keyboard"

    image2023-1-2_19-23-41-version-1-modificationdate-1672680220320-api-v2.png

    On the virtual keyboard that appears, press ALT+F4 (do this on the virtual keyboard to switch to tty4, otherwise the window will close).

  9. When the OS installation is complete (if still on tty1 (purple screen)) the screen will be black and a "Sent SIGKILL to all processes" message will appear.

    image2023-1-2_19-26-55-version-1-modificationdate-1672680414557-api-v2.png

    On the tty4 (log screen), a messages with "finish-install:" will appear.

    image2023-1-2_19-27-59-version-1-modificationdate-1672680478650-api-v2.png

  10. At this point, remove the USB from the Cyber-AI server (or reboot to BIOS as seen in step #3 and change the "Boot option #1" which was set to USB earlier to "disabled".

  11. Reboot the server. Click the "Power Control" menu and select "Power Reset".

    image2023-1-2_19-30-34-version-1-modificationdate-1672680633647-api-v2.png

  12. After the server boots up a login screen will appear.

    image2023-1-2_19-31-41-version-1-modificationdate-1672680700527-api-v2.png

    Important

    You can now log in to the server, however, the installation is not finished yet and Cyber-AI cannot be started.

  13. Additional software installation is triggered on the server's first boot. Once complete, a message will appear on all the connected terminals "UFM-OS-FIRSTBOOT-SUCCESS" in case of success, and FAILED in case the process failed.

    image2023-1-2_19-34-46-version-1-modificationdate-1672680885497-api-v2.png

    image2023-1-2_19-35-27-version-1-modificationdate-1672680926807-api-v2.png

  14. To manually check the status, run:

    Copy
    Copied!
                

    systemctl status ufm-os-firstboot

    if the installation is still running, the output provides a status.
    if the installation finished, ufm-os-firstboot will not be found and the log at /var/log/ufm-os-firstboot.log can be viewed.

    image2023-1-2_19-37-43-version-1-modificationdate-1672681063067-api-v2.png

  15. Cyber-AI is now successfully installed and can be started.

© Copyright 2023, NVIDIA. Last updated on Feb 8, 2024.