nvinfer1::IRuntimeCache Class Reference

A class for Runtime cache currently used for TensorRT JIT compilation. This cache can be serialized and deserialized to support persistence in disk files. More...

#include <NvInferRuntime.h>

Inheritance diagram for nvinfer1::IRuntimeCache:

Public Member Functions
virtual	~IRuntimeCache () noexcept=default
IHostMemory *	serialize () const noexcept
	Serialize the Runtime cache to a stream. More...
bool	deserialize (void const *blob, size_t size) noexcept
	Deserialize the Runtime cache from a stream that contains serialized Runtime cache. More...
bool	reset () noexcept
	Reset the Runtime cache. Clears all content within the cache. More...

Protected Attributes
apiv::VRuntimeCache *	mImpl

Additional Inherited Members
Protected Member Functions inherited from nvinfer1::INoCopy
	INoCopy ()=default
virtual	~INoCopy ()=default
	INoCopy (INoCopy const &other)=delete
INoCopy &	operator= (INoCopy const &other)=delete
	INoCopy (INoCopy &&other)=delete
INoCopy &	operator= (INoCopy &&other)=delete

Detailed Description

A class for Runtime cache currently used for TensorRT JIT compilation. This cache can be serialized and deserialized to support persistence in disk files.

See also

IRuntimeConfig::createRuntimeConfig()

Constructor & Destructor Documentation

~IRuntimeCache()

virtual nvinfer1::IRuntimeCache::~IRuntimeCache ( )

virtualdefaultnoexcept

Member Function Documentation

deserialize()

bool nvinfer1::IRuntimeCache::deserialize ( void const *  blob, size_t  size  )

inlinenoexcept

Deserialize the Runtime cache from a stream that contains serialized Runtime cache.

Parameters

blob	The serialized Runtime cache.

reset()

bool nvinfer1::IRuntimeCache::reset ( )

inlinenoexcept

Reset the Runtime cache. Clears all content within the cache.

serialize()

IHostMemory * nvinfer1::IRuntimeCache::serialize ( ) const

inlinenoexcept

Serialize the Runtime cache to a stream.

Returns

A IHostMemory object that contains the serialized Runtime cache.

Member Data Documentation

mImpl

apiv::VRuntimeCache* nvinfer1::IRuntimeCache::mImpl

protected

---

The documentation for this class was generated from the following file:

• NvInferRuntime.h