TensorRT  8.0.1
nvinfer1::ITimingCache Class Reference

Class to handle tactic timing info collected from builder. More...

#include <NvInfer.h>

Inheritance diagram for nvinfer1::ITimingCache:
nvinfer1::INoCopy

Public Member Functions

nvinfer1::IHostMemoryserialize () const noexcept
 Serialize a timing cache to IHostMemory object. More...
 
bool combine (const ITimingCache &inputCache, bool ignoreMismatch) noexcept
 Combine input timing cache into local instance. More...
 
bool reset () noexcept
 Empty the timing cache. More...
 

Protected Attributes

apiv::VTimingCachemImpl
 

Additional Inherited Members

- Protected Member Functions inherited from nvinfer1::INoCopy
 INoCopy (const INoCopy &other)=delete
 
INoCopyoperator= (const INoCopy &other)=delete
 
 INoCopy (INoCopy &&other)=delete
 
INoCopyoperator= (INoCopy &&other)=delete
 

Detailed Description

Class to handle tactic timing info collected from builder.

The timing cache is created or initialized by IBuilderConfig. It can be shared across builder instances to accelerate the builder wallclock time.

See also
IBuilderConfig

Member Function Documentation

◆ combine()

bool nvinfer1::ITimingCache::combine ( const ITimingCache inputCache,
bool  ignoreMismatch 
)
inlinenoexcept

Combine input timing cache into local instance.

This function allows combining entries in the input timing cache to local cache object.

Parameters
inputCacheThe input timing cache.
ignoreMismatchWhether or not to allow cache verification header mismatch.
Returns
True if combined successfully, false otherwise.

Append entries in input cache to local cache. Conflicting entries will be skipped The input cache must be generated by a TensorRT build of exact same version, otherwise combine will be skipped and return false. ignoreMismatch must be set to true if combining a timing cache created from a different device.

Warning
Combining caches generated from devices with different device properties may lead to functional/performance bugs!

◆ reset()

bool nvinfer1::ITimingCache::reset ( )
inlinenoexcept

Empty the timing cache.

Returns
True if reset successfully, false otherwise.

◆ serialize()

nvinfer1::IHostMemory* nvinfer1::ITimingCache::serialize ( ) const
inlinenoexcept

Serialize a timing cache to IHostMemory object.

This function allows serialization of current timing cache.

Returns
A pointer to a IHostMemory object that contains a serialized timing cache.
See also
IHostMemory

The documentation for this class was generated from the following file: