EngineInspector

class tensorrt.EngineInspector

An engine inspector which prints out the layer information of an engine or an execution context. The engine or the context must be set before get_layer_information() or get_engine_information() can be called.

The amount of printed information depends on the profiling verbosity setting of the builder config when the engine is built. By default, the profiling verbosity is set to ProfilingVerbosity.LAYER_NAMES_ONLY, and only layer names will be printed. If the profiling verbosity is set to ProfilingVerbosity.DETAILED, layer names and layer parameters will be printed. If the profiling verbosity is set to ProfilingVerbosity.NONE, no layer information will be printed.

Variables
  • engineICudaEngine Set or get the engine currently being inspected.

  • contextIExecutionContext Set or get context currently being inspected.

  • error_recorderIErrorRecorder Application-implemented error reporting interface for TensorRT objects.

__init__(*args, **kwargs)
get_engine_information(self: tensorrt.tensorrt.EngineInspector, format: tensorrt.tensorrt.LayerInformationFormat) str

Get a string describing the information about all the layers in the current engine or the execution context.

Parameters

formatLayerInformationFormat The format the layer information should be printed in.

Returns

A string describing the information about all the layers in the current engine or the execution context.

get_layer_information(self: tensorrt.tensorrt.EngineInspector, layer_index: int, format: tensorrt.tensorrt.LayerInformationFormat) str

Get a string describing the information about a specific layer in the current engine or the execution context.

Parameters
  • layer_index – The index of the layer. It must lie in [0, engine.num_layers].

  • formatLayerInformationFormat The format the layer information should be printed in.

Returns

A string describing the information about a specific layer in the current engine or the execution context.