TensorRT
|
Allows a serialized engine to be deserialized. More...
#include <NvInfer.h>
Public Member Functions | |
virtual nvinfer1::ICudaEngine * | deserializeCudaEngine (const void *blob, std::size_t size, IPluginFactory *pluginFactory)=0 |
Deserialize an engine from a stream. More... | |
virtual void | destroy ()=0 |
Destroy this object. | |
virtual void | setGpuAllocator (IGpuAllocator *allocator)=0 |
Set the GPU allocator. More... | |
Allows a serialized engine to be deserialized.
|
pure virtual |
Deserialize an engine from a stream.
blob | The memory that holds the serialized engine. |
size | The size of the memory. |
pluginFactory | The plugin factory, if any plugins are used by the network, otherwise nullptr. |
|
pure virtual |
Set the GPU allocator.
allocator | Set the GPU allocator to be used by the runtime. All GPU memory acquired will use this allocator. If NULL is passed, the default allocator will be used. |
Default: uses cudaMalloc/cudaFree.
If nullptr is passed, the default allocator will be used.