NVIDIA DeepStream SDK API Reference

9.2 Release
TrackerInt8EntropyCalibrator Class Reference

Detailed Description

ReID int8 calibrator used for TensorRT int8 precision inference.

Definition at line 78 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

Inheritance diagram for TrackerInt8EntropyCalibrator:
Collaboration diagram for TrackerInt8EntropyCalibrator:

Public Member Functions

 TrackerInt8EntropyCalibrator (std::string calibrationTableFile)
 Construct a calibrator that reads a serialized calibration table. More...
 
 ~TrackerInt8EntropyCalibrator ()
 Release resources owned by the TrackerInt8EntropyCalibrator instance. More...
 
int getBatchSize () const noexcept override
 Report the calibrator batch size. More...
 
bool getBatch (void *bindings[], const char *names[], int nbBindings) noexcept override
 Provide a calibration batch when available. More...
 
const void * readCalibrationCache (size_t &length) noexcept override
 Read the calibration table file into a buffer and return a pointer to it. More...
 
void writeCalibrationCache (const void *cache, size_t length) noexcept override
 Accept a generated TensorRT calibration cache. More...
 
 TrackerInt8EntropyCalibrator (std::string calibrationTableFile)
 Construct a calibrator that reads a serialized calibration table. More...
 
 ~TrackerInt8EntropyCalibrator ()
 Release resources owned by the TrackerInt8EntropyCalibrator instance. More...
 
int getBatchSize () const noexcept override
 Report the calibrator batch size. More...
 
bool getBatch (void *bindings[], const char *names[], int nbBindings) noexcept override
 Provide a calibration batch when available. More...
 
const void * readCalibrationCache (size_t &length) noexcept override
 Read the calibration table file into a buffer and return a pointer to it. More...
 
void writeCalibrationCache (const void *cache, size_t length) noexcept override
 Accept a generated TensorRT calibration cache. More...
 

Constructor & Destructor Documentation

◆ TrackerInt8EntropyCalibrator() [1/2]

TrackerInt8EntropyCalibrator::TrackerInt8EntropyCalibrator ( std::string  calibrationTableFile)
inline

Construct a calibrator that reads a serialized calibration table.

Parameters
[in]calibrationTableFilePath to the calibration-table file.

Definition at line 85 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ ~TrackerInt8EntropyCalibrator() [1/2]

TrackerInt8EntropyCalibrator::~TrackerInt8EntropyCalibrator ( )
inline

Release resources owned by the TrackerInt8EntropyCalibrator instance.

Definition at line 90 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ TrackerInt8EntropyCalibrator() [2/2]

TrackerInt8EntropyCalibrator::TrackerInt8EntropyCalibrator ( std::string  calibrationTableFile)
inline

Construct a calibrator that reads a serialized calibration table.

Parameters
[in]calibrationTableFilePath to the calibration-table file.

Definition at line 85 of file 9.2/sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ ~TrackerInt8EntropyCalibrator() [2/2]

TrackerInt8EntropyCalibrator::~TrackerInt8EntropyCalibrator ( )
inline

Member Function Documentation

◆ getBatch() [1/2]

bool TrackerInt8EntropyCalibrator::getBatch ( void *  bindings[],
const char *  names[],
int  nbBindings 
)
inlineoverridenoexcept

Provide a calibration batch when available.

Parameters
[in,out]bindingsTensorRT input and output bindings.
[in]namesTensorRT binding names.
[in]nbBindingsNumber of TensorRT bindings.

Definition at line 101 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ getBatch() [2/2]

bool TrackerInt8EntropyCalibrator::getBatch ( void *  bindings[],
const char *  names[],
int  nbBindings 
)
inlineoverridenoexcept

Provide a calibration batch when available.

Parameters
[in,out]bindingsTensorRT input and output bindings.
[in]namesTensorRT binding names.
[in]nbBindingsNumber of TensorRT bindings.

Definition at line 101 of file 9.2/sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ getBatchSize() [1/2]

int TrackerInt8EntropyCalibrator::getBatchSize ( ) const
inlineoverridenoexcept

Report the calibrator batch size.

Definition at line 93 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ getBatchSize() [2/2]

int TrackerInt8EntropyCalibrator::getBatchSize ( ) const
inlineoverridenoexcept

Report the calibrator batch size.

Definition at line 93 of file 9.2/sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ readCalibrationCache() [1/2]

const void* TrackerInt8EntropyCalibrator::readCalibrationCache ( size_t &  length)
inlineoverridenoexcept

Read the calibration table file into a buffer and return a pointer to it.

Parameters
[out]lengthCalibration-cache size to populate.
Returns
Pointer to the cache data, or null when the cache is empty.

Definition at line 109 of file 9.2/sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

References half_float::detail::binary, and length().

◆ readCalibrationCache() [2/2]

const void* TrackerInt8EntropyCalibrator::readCalibrationCache ( size_t &  length)
inlineoverridenoexcept

Read the calibration table file into a buffer and return a pointer to it.

Parameters
[out]lengthCalibration-cache size to populate.
Returns
Pointer to the cache data, or null when the cache is empty.

Definition at line 109 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

References half_float::detail::binary, and length().

◆ writeCalibrationCache() [1/2]

void TrackerInt8EntropyCalibrator::writeCalibrationCache ( const void *  cache,
size_t  length 
)
inlineoverridenoexcept

Accept a generated TensorRT calibration cache.

Parameters
[in]cacheCalibration-cache bytes to write.
[out]lengthCalibration-cache size to populate.

Definition at line 129 of file sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.

◆ writeCalibrationCache() [2/2]

void TrackerInt8EntropyCalibrator::writeCalibrationCache ( const void *  cache,
size_t  length 
)
inlineoverridenoexcept

Accept a generated TensorRT calibration cache.

Parameters
[in]cacheCalibration-cache bytes to write.
[out]lengthCalibration-cache size to populate.

Definition at line 129 of file 9.2/sources/libs/nvmultiobjecttracker/include/modules/FrameTransform/trtModule.hpp.


The documentation for this class was generated from the following file: