Note

Due to changes in the TensorRT API between versions 8.0.x and 7.2.x, the deployable models generated using the export task in TAO 3.0-21.11+ can only be deployed in DeepStream version 6.0. In order to deploy the models compatible with DeepStream 5.1, you will need to re-export the model using the TAO 3.0-21.08 package to re-generate a deployable model and calibration cache file that is compatible with TensorRT 7.2.

Similarly, if you have a model trained with TAO 3.0-21.08 package and want to deploy to DeepStream 6.0, please regenerate the deployable model.etlt and int8 calibration file by re-exporting it in TAO 3.0-21.11+.

TAO 3.0-21.11+ was built with TensorRT 8.0.1.6.

../../_images/ds_tao_interoperability.png

TAO -> DeepStream version interoperability#