Runtime

class tensorrt.Runtime(self: tensorrt.tensorrt.Runtime, logger: tensorrt.tensorrt.ILogger) → None

Allows a serialized ICudaEngine to be deserialized.

Variables

  • error_recorder – IErrorRecorder Application-implemented error reporting interface for TensorRT objects.

  • gpu_allocator – IGpuAllocator The GPU allocator to be used by the Runtime . All GPU memory acquired will use this allocator. If set to None, the default allocator will be used (Default: cudaMalloc/cudaFree).

  • DLA_core – int The DLA core that the engine executes on. Must be between 0 and N-1 where N is the number of available DLA cores.

  • num_DLA_cores – int The number of DLA engines available to this builder.

  • logger – ILogger The logger provided when creating the refitter.

Parameters

logger – The logger to use.

__del__(self: tensorrt.tensorrt.Runtime) → None
__exit__(exc_type, exc_value, traceback)

Context managers are deprecated and have no effect. Objects are automatically freed when the reference count reaches 0.

__init__(self: tensorrt.tensorrt.Runtime, logger: tensorrt.tensorrt.ILogger) → None
Parameters

logger – The logger to use.

deserialize_cuda_engine(self: tensorrt.tensorrt.Runtime, serialized_engine: buffer) → tensorrt.tensorrt.ICudaEngine

Deserialize an ICudaEngine from a stream.

Parameters

serialized_engine – The buffer that holds the serialized ICudaEngine .

Returns

The ICudaEngine, or None if it could not be deserialized.