Optimize Torch linear model

In this example, we show how to optimize TensorRT linear model. We recommend running this example in NVIDIA NGC PyTorch container.

Example must be executed from its directory

cd examples/13_optimize_tensorrt_linear_model

Generate TensorRT model

TensorRT plan must be generated on the target machine.

python ./generate_tensorrt_model.py

Run model optimization

To run the example, simply run the optimize.py script:

python ./optimize.py