Class to handle tactic timing info collected from builder. More...
#include <NvInfer.h>
Public Member Functions | |
| nvinfer1::IHostMemory * | serialize () const noexcept |
| Serialize a timing cache to IHostMemory object. More... | |
| bool | combine (const ITimingCache &inputCache, bool ignoreMismatch) noexcept |
| Combine input timing cache into local instance. More... | |
| bool | reset () noexcept |
| Empty the timing cache. More... | |
Protected Attributes | |
| apiv::VTimingCache * | mImpl |
Additional Inherited Members | |
 Protected Member Functions inherited from nvinfer1::INoCopy | |
| INoCopy (const INoCopy &other)=delete | |
| INoCopy & | operator= (const INoCopy &other)=delete |
| INoCopy (INoCopy &&other)=delete | |
| INoCopy & | operator= (INoCopy &&other)=delete |
Detailed Description
Class to handle tactic timing info collected from builder.
The timing cache is created or initialized by IBuilderConfig. It can be shared across builder instances to accelerate the builder wallclock time.
- See also
- IBuilderConfig
Member Function Documentation
◆ combine()
|
inlinenoexcept |
Combine input timing cache into local instance.
This function allows combining entries in the input timing cache to local cache object.
- Parameters
-
inputCache The input timing cache. ignoreMismatch Whether or not to allow cache verification header mismatch.
- Returns
- True if combined successfully, false otherwise.
Append entries in input cache to local cache. Conflicting entries will be skipped The input cache must be generated by a TensorRT build of exact same version, otherwise combine will be skipped and return false. ignoreMismatch must be set to true if combining a timing cache created from a different device.
- Warning
- Combining caches generated from devices with different device properties may lead to functional/performance bugs!
◆ reset()
|
inlinenoexcept |
Empty the timing cache.
- Returns
- True if reset successfully, false otherwise.
◆ serialize()
|
inlinenoexcept |
Serialize a timing cache to IHostMemory object.
This function allows serialization of current timing cache.
- Returns
- A pointer to a IHostMemory object that contains a serialized timing cache.
- See also
- IHostMemory
The documentation for this class was generated from the following file:
