TensorRT 8.6.1
|
Application-implemented interface for profiling. More...
#include <NvInferRuntime.h>
Public Member Functions | |
virtual void | reportLayerTime (char const *layerName, float ms) noexcept=0 |
Layer time reporting callback. More... | |
virtual | ~IProfiler () noexcept |
Application-implemented interface for profiling.
When this class is added to an execution context, the profiler will be called once per layer for each invocation of executeV2()/enqueueV2()/enqueueV3().
It is not recommended to run inference with profiler enabled when the inference execution time is critical since the profiler may affect execution time negatively.
|
inlinevirtualnoexcept |
|
pure virtualnoexcept |
Layer time reporting callback.
layerName | The name of the layer, set when constructing the network definition. If the engine is built with profiling verbosity set to kNONE, the layerName is the decimal index of the layer. |
ms | The time in milliseconds to execute the layer. |