Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder.
More...
#include <NvInfer.h>
Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder.
- Note
- A layer in context of algorithm selection may be different from ILayer in INetworkDefiniton. For example, an algorithm might be implementing a conglomeration of multiple ILayers in INetworkDefinition.
◆ reportAlgorithms()
virtual void nvinfer1::IAlgorithmSelector::reportAlgorithms |
( |
const IAlgorithmContext *const * |
algoContexts, |
|
|
const IAlgorithm *const * |
algoChoices, |
|
|
int32_t |
nbAlgorithms |
|
) |
| |
|
pure virtualnoexcept |
Called by TensorRT to report choices it made.
- Note
- For a given optimization profile, this call comes after all calls to selectAlgorithms. algoChoices[i] is the choice that TensorRT made for algoContexts[i], for i in [0, nbAlgorithms-1]
- Parameters
-
algoContexts | The list of all algorithm contexts. |
algoChoices | The list of algorithm choices made by TensorRT |
nbAlgorithms | The size of algoContexts as well as algoChoices. |
◆ selectAlgorithms()
virtual int32_t nvinfer1::IAlgorithmSelector::selectAlgorithms |
( |
const IAlgorithmContext & |
context, |
|
|
const IAlgorithm *const * |
choices, |
|
|
int32_t |
nbChoices, |
|
|
int32_t * |
selection |
|
) |
| |
|
pure virtualnoexcept |
Select Algorithms for a layer from the given list of algorithm choices.
- Returns
- The number of choices selected from [0, nbChoices-1].
- Parameters
-
context | The context for which the algorithm choices are valid. |
choices | The list of algorithm choices to select for implementation of this layer. |
nbChoices | Number of algorithm choices. |
selection | The user writes indices of selected choices in to selection buffer which is of size nbChoices. |
- Note
- TensorRT uses its default algorithm selection to choose from the list provided. If return value is 0, TensorRT's default algorithm selection is used unless BuilderFlag::kREJECT_EMPTY_ALGORITHMS (or the deprecated BuilderFlag::kSTRICT_TYPES) is set. The list of choices is valid only for this specific algorithm context.
The documentation for this class was generated from the following file: