Installation

The Triton-enabled VFX and AR SDKs consist of two components: the SDK package and the server. You must install the SDK package before installing the server.

SDK Package

The SDK is delivered as a .tgz package, which is a compressed tar format.

The package contains the AR or VFX SDK library and header files, which need to be extracted to the local system. In the SDK package, see the README_quickstart.md file for more detailed instructions about setting up the environment to use the SDK.

• Install the SDK:

  AR SDK

  $ sudo tar -xvf ARSDK_linux_<version>.tgz -C /usr/local
  

  VFX SDK

  $ sudo tar -xvf VFXSDK_linux_<version>.tgz -C /usr/local
  

• Build and install the Triton client library and dependencies:

  AR SDK

  $ sudo bash /usr/local/ARSDK/share/build_triton_client_lib.sh -i /usr/local/ARSDK/lib
  

  VFX SDK

  $ sudo bash /usr/local/VideoFX/share/build_triton_client_lib.sh -i /usr/local/VideoFX/lib
  

Server

The server is delivered as a .tgz package and contains the SDK libraries. The server runs inside the Triton Docker container.

As prerequisites, you must install the appropriate NVIDIA Graphics Driver for Linux, Docker Engine, and the NVIDIA Container Toolkit.

• NVIDIA Graphics Driver for Linux

  • AR SDK: Software Requirements.

  • VFX SDK: Software Requirements.

• Docker

  • Ubuntu, CentOS, or Debian: Install Docker Engine.

  • Rocky Linux 8: Docker - Install Engine.

  • Rocky Linux 9: Docker - Install Engine.

• NVIDIA Container Toolkit: Follow the installation and Docker configuration instructions in Installing the NVIDIA Container Toolkit.

To install the server package, untar the package to a location of your choice. The following example shows how to install the package in your home directory and change the directory to the installation location:

AR SDK

$ tar -xvf ARSDK_triton_<version>.tgz -C ~
$ cd ~/ARSDK-triton-server

VFX SDK

$ tar -xvf VFXSDK_triton_<version>.tgz -C ~
$ cd ~/VideoFX-triton-server

You must initialize the model repository by adding the model files. The following example shows how to initialize the model repository by specifying your NGC account with organization and team, AI feature, and model repo from anywhere within the appropriate root folder (such as ARSDK-triton-server or VideoFX-triton-server):

AR SDK

$ export NGC_CLI_API_KEY=<your_API_key>
$ sudo --preserve-env=NGC_CLI_API_KEY ./init_model_repo.sh --ngc-org org --ngc-team team -f all --modelrepo ~/ARSDK-triton-server/arsdk_model_repo

VFX SDK

$ export NGC_CLI_API_KEY=<your_API_key>
$ sudo --preserve-env=NGC_CLI_API_KEY ./init_model_repo.sh --ngc-org org --ngc-team team -f all --modelrepo ~/VideoFX-triton-server/vfxsdk_model_repo

Run the following script to download the Docker image and run the Triton server:

$ sudo bash run_triton_server.sh

The script runs the Triton server and loads the SDK features. If successful, the server displays messages saying the gRPC and metric services started and blocks the terminal as shown:

I0411 22:05:33.459919 1 grpc_server.cc:4819] Started GRPCInferenceService at 0.0.0.0:8001
I0411 22:05:33.502086 1 http_server.cc:184] Started Metrics Service at 0.0.0.0:8002

Check the displayed messages and verify that the following information appears, showing that all models are loaded.

AR SDK

+-----------------------+---------+--------+
| Model                 | Version | Status |
+-----------------------+---------+--------+
| FaceBox               | 1       | READY  |
| FaceKeypoints126Mode0 | 1       | READY  |
| FaceKeypoints126Mode1 | 1       | READY  |
| FaceKeypoints68Mode0  | 1       | READY  |
| FaceKeypoints68Mode1  | 1       | READY  |
| GazeRedirectionKey126 | 1       | READY  |
| GazeRedirectionKey68  | 1       | READY  |
| LipSync               | 1       | READY  |
| LipSyncU16            | 1       | READY  |
| ActiveSpeakerDetection| 1       | READY  |
+-----------------------+---------+--------+

VFX SDK

+----------------------------+---------+--------+
| Model                      | Version | Status |
+----------------------------+---------+--------+
| AigsMode0                  | 1       | READY  |
| AigsMode1                  | 1       | READY  |
| AigsMode2                  | 1       | READY  |
| AigsMode3                  | 1       | READY  |
| BackgroundBlur             | 1       | READY  |
| CompAigsRelightingBkgMode1 | 1       | READY  |
| CompAigsRelightingBkgMode3 | 1       | READY  |
| CompAigsRelightingPrjMode1 | 1       | READY  |
| CompAigsRelightingPrjMode3 | 1       | READY  |
| CompAigsRelightingSrcMode1 | 1       | READY  |
| CompAigsRelightingSrcMode3 | 1       | READY  |
| RelightingProj0Mode1       | 1       | READY  |
| RelightingProj1Mode1       | 1       | READY  |
+----------------------------+---------+--------+