The general TensorRT workflow consists of 3 steps:
tensorrt.INetworkDefinitioneither with a parser or by using the TensorRT Network API (see
tensorrt.INetworkDefinitionfor more details). The
tensorrt.Buildercan be used to generate an empty
Most other TensorRT classes use a logger to report errors, warnings and informative messages. TensorRT provides a basic
tensorrt.Logger implementation, but it can be extended for more advanced functionality.
Engine and Context¶
tensorrt.INetworkDefinition represents a computational graph. In order to populate the network, TensorRT provides a suite of parsers for a variety of Deep Learning frameworks. It is also possible to populate the network manually using the Network API.