TensorRT  8.0.2
nvinfer1::IInt8LegacyCalibrator Class Referenceabstract

#include <NvInfer.h>

Inheritance diagram for nvinfer1::IInt8LegacyCalibrator:
nvinfer1::IInt8Calibrator

Public Member Functions

CalibrationAlgoType getAlgorithm () noexcept override
 
virtual double getQuantile () const noexcept=0
 The quantile (between 0 and 1) that will be used to select the region maximum when the quantile method is in use. More...
 
virtual double getRegressionCutoff () const noexcept=0
 The fraction (between 0 and 1) of the maximum used to define the regression cutoff when using regression to determine the region maximum. More...
 
virtual const void * readHistogramCache (std::size_t &length) noexcept=0
 Load a histogram. More...
 
virtual void writeHistogramCache (const void *ptr, std::size_t length) noexcept=0
 Save a histogram cache. More...
 
- Public Member Functions inherited from nvinfer1::IInt8Calibrator
virtual int32_t getBatchSize () const noexcept=0
 Get the batch size used for calibration batches. More...
 
virtual bool getBatch (void *bindings[], const char *names[], int32_t nbBindings) noexcept=0
 Get a batch of input for calibration. More...
 
virtual const void * readCalibrationCache (std::size_t &length) noexcept=0
 Load a calibration cache. More...
 
virtual void writeCalibrationCache (const void *ptr, std::size_t length) noexcept=0
 Save a calibration cache. More...
 

Detailed Description

Legacy calibrator left for backward compatibility with TensorRT 2.0. This calibrator requires user parameterization, and is provided as a fallback option if the other calibrators yield poor results.

Member Function Documentation

◆ getAlgorithm()

CalibrationAlgoType nvinfer1::IInt8LegacyCalibrator::getAlgorithm ( )
inlineoverridevirtualnoexcept

Signal that this is the legacy calibrator.

Implements nvinfer1::IInt8Calibrator.

◆ getQuantile()

virtual double nvinfer1::IInt8LegacyCalibrator::getQuantile ( ) const
pure virtualnoexcept

The quantile (between 0 and 1) that will be used to select the region maximum when the quantile method is in use.

See the user guide for more details on how the quantile is used.

◆ getRegressionCutoff()

virtual double nvinfer1::IInt8LegacyCalibrator::getRegressionCutoff ( ) const
pure virtualnoexcept

The fraction (between 0 and 1) of the maximum used to define the regression cutoff when using regression to determine the region maximum.

See the user guide for more details on how the regression cutoff is used

◆ readHistogramCache()

virtual const void* nvinfer1::IInt8LegacyCalibrator::readHistogramCache ( std::size_t &  length)
pure virtualnoexcept

Load a histogram.

Histogram generation is potentially expensive, so it can be useful to generate the histograms once, then use them when exploring the space of calibrations. The histograms should be regenerated if the network structure changes, or the input data set changes, and it is the responsibility of the application to ensure this.

Parameters
lengthThe length of the cached data, that should be set by the called function. If there is no data, this should be zero.
Returns
A pointer to the cache, or nullptr if there is no data.

◆ writeHistogramCache()

virtual void nvinfer1::IInt8LegacyCalibrator::writeHistogramCache ( const void *  ptr,
std::size_t  length 
)
pure virtualnoexcept

Save a histogram cache.

Parameters
ptrA pointer to the data to cache.
lengthThe length in bytes of the data to cache.
See also
readHistogramCache()

The documentation for this class was generated from the following file: