Upgrading TensorRT#

Upgrading TensorRT to the latest version is only supported when the currently installed TensorRT version is equal to or newer than the last two public GA releases.

If you want to upgrade from an unsupported version, you should incrementally upgrade until you reach the latest version of TensorRT or uninstall and reinstall the newest version. If you have an EA version of TensorRT installed, you should first upgrade to the corresponding GA version.

Upgrading From TensorRT 10.x.x To TensorRT 10.8.x#

When upgrading from TensorRT 10.x.x to TensorRT 10.8.x, ensure you are familiar with the following.

Using a Debian file

  • The Debian packages are designed to upgrade your development environment without removing any runtime components that other packages and programs might rely on. If you installed TensorRT 10.x.x using a Debian package and upgraded to TensorRT 10.8.x, your libraries (within minor versions), samples, and headers will all be updated to TensorRT 10.8.x content.

  • When upgrading between TensorRT major versions, for example, from TensorRT 9.x to TensorRT 10.x, runtime packages from both major versions will coexist and not be replaced. Only the development packages (C++ headers, .a files, .so files without a version) will be replaced when upgrading to a new TensorRT major version.

  • After downloading the new local repo, use apt-get to upgrade your system to the new version of TensorRT.

    os="ubuntuxx04"
tag="10.x.x-cuda-x.x"
sudo dpkg -i nv-tensorrt-local-repo-${os}-${tag}_1.0-1_amd64.deb
sudo cp /var/nv-tensorrt-local-repo-${os}-${tag}/*-keyring.gpg /usr/share/keyrings

sudo apt-get update
sudo apt-get install tensorrt

  • After you upgrade, ensure you have a directory /usr/src/tensorrt, and the corresponding version shown by the dpkg-query -W tensorrt command is 10.x.x.x.

  • If installing a Debian package on a system where the previously installed version was from a tar file, note that the Debian package will not remove the previously installed files. Removing the older version before installing the new version would be best to avoid compiling against outdated libraries unless a side-by-side installation is desired.

Using an RPM file

  • The RPM packages are designed to upgrade your development environment without removing any runtime components that other packages and programs might rely on if you installed TensorRT 10.x.x via an RPM package and want to upgrade to TensorRT 10.8.x, your libraries (within minor versions), samples, and headers will all be updated to TensorRT 10.8.x content.

  • When upgrading between TensorRT major versions, for example, from TensorRT 9.x to TensorRT 10.x, runtime packages from both major versions will coexist and not be replaced. Only the development packages (C++ headers, .a files, .so files without a version) will be replaced when upgrading to a new TensorRT major version.

  • After you have downloaded the new local repo, run the following:

    os="rhelx"
tag="10.x.x-cuda-x.x"
sudo rpm -Uvh nv-tensorrt-local-repo-${os}-${tag}-1.0-1.x86_64.rpm
sudo yum clean expire-cache
sudo yum install tensorrt

  • After you upgrade, ensure you see the /usr/src/tensorrt directory, and the corresponding version shown by the rpm -q tensorrt command is 10.x.x.x.

Using a tar file

  • If you upgrade using the tar file installation method, install TensorRT in a new location. Tar file installations can support multiple use cases, including having a full installation of TensorRT 10.x.x with headers and libraries side-by-side with a full installation of TensorRT 10.8.x. If the intention is to have the new version of TensorRT replace the old version, then the old version should be removed once the new version is verified.

  • For the new TensorRT tar file installation, update the environment variable LD_LIBRARY_PATH to the absolute path containing the TensorRT lib directory.

  • If installing a tar file on a system where the previously installed version was from a Debian package, note that the tar file installation will not remove the previously installed packages. Unless a side-by-side installation is desired, removing the previously installed libnvinfer10, libnvinfer-dev, libnvinfer-samples, and other related packages would be best to avoid confusion.

Using a zip file

  • If you upgrade using the zip file installation method, install TensorRT in a new location. Zip file installations can support multiple use cases, including having a full installation of TensorRT 10.x.x with headers and libraries side-by-side with a full installation of TensorRT 10.8.x. If the intention is to have the new version of TensorRT replace the old version, then the old version should be removed once the new version is verified.

  • After unzipping the new version of TensorRT, you must either update the PATH environment variable to point to the new installation location or copy the DLL files to the location where you previously installed the TensorRT libraries. Refer to Zip File Installation for more information about setting the PATH environment variable.

On this page