Introduction

NVIDIA Fleet Command deploys container-based applications on GPU-accelerated Kubernetes clusters using Helm charts. This guide will provide the information necessary to build applications compatible with Fleet Command and includes information on setting up a development environment.

Containerization involves bundling an application with all of its related configuration files, libraries, and dependencies required to run efficiently for portability. While containers are an excellent way to bundle and run applications, it is essential to manage the containers that run the applications and ensure no downtime in a deployment environment.

Kubernetes is an open-source platform for managing containerized applications. For example, if a container goes down, another container needs to start. Kubernetes helps in maintaining container life cycles without any human intervention.

Fleet Command leverages these technologies to provide a fully supported cloud-native platform that securely deploys, manages, and scales your applications across a distributed edge infrastructure.

Applications deployed on NVIDIA Fleet Command must run on the following software stack:

• Ubuntu 20.04 LTS

• CUDA 11.7

  • NVIDIA Driver 515.86.01 (Pre-compiled signed driver)

• Containerd 1.6.15-1

• Kubernetes 1.24.9

• NVIDIA Container Toolkit 1.10.0-1

• Helm 3.10.2

The environment also includes the NVIDIA libraries listed below with NVIDIA Driver 515.86.01:

• libnvidia-cfg1-515-server:amd64

• libnvidia-common-515-server

• libnvidia-compute-515-server:amd64

• libnvidia-container-tools

• libnvidia-container1:amd64

• libnvidia-decode-515-server:amd64

• libnvidia-encode-515-server:amd64

• libnvidia-fbc1-515-server:amd64

• libnvidia-gl-515-server:amd64

• linux-objects-nvidia-515-server-5.4.0-125-generic

• linux-signatures-nvidia-5.4.0-125-generic

• nvidia-compute-utils-515-server

• nvidia-container-toolkit

• nvidia-kernel-common-515-server

• nvidia-mig-manager

• nvidia-utils-515-server

Details on replicating this software stack are provided later in this guide, in the Development Environment section.

Instructions on setting up this software stack manually for development purposes are provided later in this guide, in the Development Environment section.