TAO Toolkit v5.3.0

For an x86 platform with discrete GPUs, the default TAO package includes the tao-converter built for TensorRT with CUDA 11.4 and CUDNN 8.2. However, for any other version of CUDA and TensorRT, please refer to the overview section for download. Once the tao-converter is downloaded, follow the instructions below to generate a TensorRT engine.

  1. Unzip the zip file on the target machine.

  2. Install the OpenSSL package using the command:

    sudo apt-get install libssl-dev
  3. Export the following environment variables:

$ export TRT_LIB_PATH=”/usr/lib/x86_64-linux-gnu”
$ export TRT_INC_PATH=”/usr/include/x86_64-linux-gnu”
  1. Run the tao-converter using the sample command below and generate the engine.


Make sure to follow the output node names as mentioned in Exporting the Model section of the respective model.

© Copyright 2024, NVIDIA. Last updated on Mar 22, 2024.