Operators Documentation#

In TensorRT, operators represent distinct flavors of mathematical and programmatic operations. The following sections describe every operator that TensorRT supports. The minimum workspace required by TensorRT depends on the operators used by the network. A suggested minimum build-time setting is 16 MB. Regardless of the maximum workspace value provided to the builder, TensorRT will allocate at runtime no more than the workspace it requires.

Interface - TensorRT Operators

See also

ONNX Operator Support

Full list of supported ONNX operators and version ranges.

TensorRT Support Matrix

Platform, GPU, and software compatibility for the current release.

Extending TensorRT with Custom Layers

How to implement custom operators as TensorRT plugins.

Troubleshooting

ONNX import errors and unsupported operator diagnostics.