Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder.
More...
#include <NvInfer.h>
Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder.
- Note
- A layer in context of algorithm selection may be different from ILayer in INetworkDefiniton. For example, an algorithm might be implementing a conglomeration of multiple ILayers in INetworkDefinition.
◆ reportAlgorithms()
| virtual void nvinfer1::IAlgorithmSelector::reportAlgorithms |
( |
const IAlgorithmContext *const * |
algoContexts, |
|
|
const IAlgorithm *const * |
algoChoices, |
|
|
int32_t |
nbAlgorithms |
|
) |
| |
|
pure virtualnoexcept |
Called by TensorRT to report choices it made.
- Note
- For a given optimization profile, this call comes after all calls to selectAlgorithms. algoChoices[i] is the choice that TensorRT made for algoContexts[i], for i in [0, nbAlgorithms-1]
- Parameters
-
| algoContexts | The list of all algorithm contexts. |
| algoChoices | The list of algorithm choices made by TensorRT |
| nbAlgorithms | The size of algoContexts as well as algoChoices. |
◆ selectAlgorithms()
| virtual int32_t nvinfer1::IAlgorithmSelector::selectAlgorithms |
( |
const IAlgorithmContext & |
context, |
|
|
const IAlgorithm *const * |
choices, |
|
|
int32_t |
nbChoices, |
|
|
int32_t * |
selection |
|
) |
| |
|
pure virtualnoexcept |
Select Algorithms for a layer from the given list of algorithm choices.
- Returns
- The number of choices selected from [0, nbChoices-1].
- Parameters
-
| context | The context for which the algorithm choices are valid. |
| choices | The list of algorithm choices to select for implementation of this layer. |
| nbChoices | Number of algorithm choices. |
| selection | The user writes indices of selected choices in to selection buffer which is of size nbChoices. |
- Note
- TensorRT uses its default algorithm selection to choose from the list provided. If return value is 0, TensorRT’s default algorithm selection is used unless strict type constraints are set. The list of choices is valid only for this specific algorithm context.
The documentation for this class was generated from the following file:
1.8.16