TensorRT 8.5.3
|
#include <NvInfer.h>
Public Member Functions | |
CalibrationAlgoType | getAlgorithm () noexcept override |
virtual double | getQuantile () const noexcept=0 |
The quantile (between 0 and 1) that will be used to select the region maximum when the quantile method is in use. More... | |
virtual double | getRegressionCutoff () const noexcept=0 |
The fraction (between 0 and 1) of the maximum used to define the regression cutoff when using regression to determine the region maximum. More... | |
virtual void const * | readHistogramCache (std::size_t &length) noexcept=0 |
Load a histogram. More... | |
virtual void | writeHistogramCache (void const *ptr, std::size_t length) noexcept=0 |
Save a histogram cache. More... | |
virtual | ~IInt8LegacyCalibrator () noexcept=default |
Public Member Functions inherited from nvinfer1::IInt8Calibrator | |
virtual int32_t | getBatchSize () const noexcept=0 |
Get the batch size used for calibration batches. More... | |
virtual bool | getBatch (void *bindings[], char const *names[], int32_t nbBindings) noexcept=0 |
Get a batch of input for calibration. More... | |
virtual void const * | readCalibrationCache (std::size_t &length) noexcept=0 |
Load a calibration cache. More... | |
virtual void | writeCalibrationCache (void const *ptr, std::size_t length) noexcept=0 |
Save a calibration cache. More... | |
virtual | ~IInt8Calibrator () noexcept=default |
Legacy calibrator left for backward compatibility with TensorRT 2.0. This calibrator requires user parameterization, and is provided as a fallback option if the other calibrators yield poor results.
|
virtualdefaultnoexcept |
|
inlineoverridevirtualnoexcept |
Signal that this is the legacy calibrator.
Implements nvinfer1::IInt8Calibrator.
|
pure virtualnoexcept |
The quantile (between 0 and 1) that will be used to select the region maximum when the quantile method is in use.
See the user guide for more details on how the quantile is used.
|
pure virtualnoexcept |
The fraction (between 0 and 1) of the maximum used to define the regression cutoff when using regression to determine the region maximum.
See the user guide for more details on how the regression cutoff is used
|
pure virtualnoexcept |
Load a histogram.
Histogram generation is potentially expensive, so it can be useful to generate the histograms once, then use them when exploring the space of calibrations. The histograms should be regenerated if the network structure changes, or the input data set changes, and it is the responsibility of the application to ensure this.
length | The length of the cached data, that should be set by the called function. If there is no data, this should be zero. |
|
pure virtualnoexcept |
Save a histogram cache.
ptr | A pointer to the data to cache. |
length | The length in bytes of the data to cache. |
Copyright © 2024 NVIDIA Corporation
Privacy Policy |
Manage My Privacy |
Do Not Sell or Share My Data |
Terms of Service |
Accessibility |
Corporate Policies |
Product Security |
Contact