::

The NVIDIA container image for TensorRT, release 20.02, is available on NGC.

Contents of the TensorRT container

The TensorRT C++ samples and C++ API documentation. The samples can be built by running make in the /workspace/tensorrt/samples directory. The resulting executables are in the /workspace/tensorrt/bin directory. The C++ API documentation can be found in the /workspace/tensorrt/doc/cpp directory.
The TensorRT Python samples and Python API documentation. The Python samples can be found in the /workspace/tensorrt/samples/python directory. Many Python samples can be run using python <script.py> -d /workspace/tensorrt/data. For example:
```
python caffe_resnet50.py -d /workspace/tensorrt/data
```
The Python API documentation can be found in the /workspace/tensorrt/doc/python directory.
TensorRT 7.0.0

The container also includes the following:

Ubuntu 18.04
Note: Container image 20.02-py3 contains Python 3.6.
NVIDIA CUDA 10.2.89 including cuBLAS 10.2.2.89
NVIDIA cuDNN 7.6.5
NVIDIA NCCL 2.5.6 (optimized for NVLink™ )
Note: Although NCCL is packaged in the container, it does not affect TensorRT nor inferencing in any way.
MLNX_OFED
OpenMPI 3.1.4
Nsight Compute 2019.5.0
Nsight Systems 2020.1.1

Driver Requirements

Release 20.02 is based on NVIDIA CUDA 10.2.89, which requires NVIDIA Driver release 440.33.01. However, if you are running on Tesla (for example, T4 or any other Tesla board), you may use NVIDIA driver release 396, 384.111+, 410, 418.xx or 440.30. The CUDA driver's compatibility package only supports particular drivers. For a complete list of supported drivers, see the CUDA Application Compatibility topic. For more information, see CUDA Compatibility and Upgrades.

GPU Requirements

Release 20.02 supports CUDA compute capability 3.0 and higher. This corresponds to GPUs in the Pascal, Volta, and Turing families. Specifically, for a list of GPUs that this compute capability corresponds to, see CUDA GPUs. For additional support details, see Deep Learning Frameworks Support Matrix.

Key Features and Enhancements

This TensorRT release includes the following key features and enhancements.

TensorRT container image version 20.02 is based on TensorRT 7.0.0.
The latest version of Nsight Systems 2020.1.1
Ubuntu 18.04 with January 2020 updates

Announcements

Python 2.7 is no longer supported in this TensorRT container release.

Obtaining Missing Data Files

Some samples require data files that are not included within the TensorRT container either due to licensing restrictions or because they are too large. Samples which do not include all the required data files include a README.md file in the corresponding source directory informing you how to obtain the necessary data files.

Installing Required Python Modules

You may need to first run the Python setup script in order to complete some of the samples. The following script has been added to the container to install the missing Python modules and their dependencies if desired: /opt/tensorrt/python/python_setup.sh

Installing Open Source Components

A script has been added to clone, build and replace the provided plugin, Caffe parser, and ONNX parser libraries with the open source ones based off the 20.02 tag on the official TensorRT open source repository.

To install the open source components inside the container, run the following commands to install the required prerequisites and run the installation script:

apt-get update && apt-get install libcurl4-openssl-dev zlib1g-dev
    pkg-config

curl -L -k -o /opt/cmake-3.14.4-Linux-x86_64.tar.gz
        https://github.com/Kitware/CMake/releases/download/v3.14.4/cmake-3.14.4-Linux-x86_64.tar.gz
        && pushd /opt && tar -xzf cmake-3.14.4-Linux-x86_64.tar.gz && rm
        cmake-3.14.4-Linux-x86_64.tar.gz && popd && export
        PATH=/opt/cmake-3.14.4-Linux-x86_64/bin/:$PATH

chmod +x /opt/tensorrt/install_opensource.sh &&
      /opt/tensorrt/install_opensource.sh

For more information see GitHub: TensorRT 20.02.

Limitations

Accelerating Inference In TensorFlow with TensorRT (TF-TRT) is not supported in the TensorRT containers.

NVIDIA TensorRT Container Versions

The following table shows what versions of Ubuntu, CUDA, and TensorRT are supported in each of the NVIDIA containers for TensorRT. For older container versions, refer to the Frameworks Support Matrix.

Container Version	Ubuntu	CUDA Toolkit	TensorRT
20.02 20.01	18.04 16.04	NVIDIA CUDA 10.2.89	TensorRT 7.0.0
19.12 19.11		NVIDIA CUDA 10.2.89	TensorRT 6.0.1
19.10		NVIDIA CUDA 10.1.243
19.09
19.08			TensorRT 5.1.5

Known Issues

There are no known issues in this release.

TensorRT Release 20.02