Runtime

class tensorrt.Runtime(self: tensorrt.tensorrt.Runtime, logger: tensorrt.tensorrt.ILogger) → None

Allows a serialized ICudaEngine to be deserialized.

Parameters:logger – The logger to use. This should be a derived class of ILogger .

deserialize_cuda_engine(self: tensorrt.tensorrt.Runtime, serialized_engine: buffer, plugin_factory: tensorrt.tensorrt.IPluginFactory = None) → tensorrt.tensorrt.ICudaEngine

Deserialize an ICudaEngine from a stream.

Parameters:

• serialized_engine – The buffer that holds the serialized ICudaEngine .
• plugin_factory – The IPluginFactory , if any plugins are used by the network, otherwise None.

Returns:

The ICudaEngine, or None if it could not be deserialized.