TensorRT
6.0.1.5
|
Base class for all layer classes in a network definition. More...
#include <NvInfer.h>
Public Member Functions | |
virtual LayerType | getType () const =0 |
Return the type of a layer. More... | |
virtual void | setName (const char *name)=0 |
Set the name of a layer. More... | |
virtual const char * | getName () const =0 |
Return the name of a layer. More... | |
virtual int | getNbInputs () const =0 |
Get the number of inputs of a layer. | |
virtual ITensor * | getInput (int index) const =0 |
Get the layer input corresponding to the given index. More... | |
virtual int | getNbOutputs () const =0 |
Get the number of outputs of a layer. | |
virtual ITensor * | getOutput (int index) const =0 |
Get the layer output corresponding to the given index. More... | |
virtual void | setInput (int index, ITensor &tensor)=0 |
replace an input of this layer with a specific tensor More... | |
virtual void | setPrecision (DataType dataType)=0 |
Set the computational precision of this layer. More... | |
virtual DataType | getPrecision () const =0 |
get the computational precision of this layer More... | |
virtual bool | precisionIsSet () const =0 |
whether the computational precision has been set for this layer More... | |
virtual void | resetPrecision ()=0 |
reset the computational precision for this layer More... | |
virtual void | setOutputType (int index, DataType dataType)=0 |
Set the output type of this layer. More... | |
virtual DataType | getOutputType (int index) const =0 |
get the output type of this layer More... | |
virtual bool | outputTypeIsSet (int index) const =0 |
whether the output type has been set for this layer More... | |
virtual void | resetOutputType (int index)=0 |
reset the output type for this layer More... | |
Base class for all layer classes in a network definition.
|
pure virtual |
Get the layer input corresponding to the given index.
index | The index of the input tensor. |
|
pure virtual |
Return the name of a layer.
|
pure virtual |
Get the layer output corresponding to the given index.
|
pure virtual |
get the output type of this layer
index | the index of the output |
|
pure virtual |
get the computational precision of this layer
|
pure virtual |
Return the type of a layer.
|
pure virtual |
whether the output type has been set for this layer
index | the index of the output |
|
pure virtual |
whether the computational precision has been set for this layer
|
pure virtual |
reset the output type for this layer
index | the index of the output |
|
pure virtual |
reset the computational precision for this layer
|
pure virtual |
replace an input of this layer with a specific tensor
Except of IShuffleLayer and ISliceLayer, this method cannot change the number of inputs to a layer. The index argument must be less than the value of getNbInputs().
See comments for IShuffleLayer::setInput() and ISliceLayer::setInput() for their special behavior.
index | the index of the input to modify. |
tensor | the new input tensor |
Implemented in nvinfer1::IResizeLayer, nvinfer1::ISliceLayer, and nvinfer1::IShuffleLayer.
|
pure virtual |
|
pure virtual |
Set the output type of this layer.
Setting the output type constrains TensorRT to choose implementations which generate output data with the given type. If it is not set, TensorRT will select output type based on layer computational precision. TensorRT could still choose non-conforming output type based on fastest implementation. Use BuilderFlag::kSTRICT_TYPES to force choose requested output type. In case layer precision is not specified, output type would depend on choosen implementation based on performance considerations and the flags specified to the builder. Note that this method cannot be used to set the data type of the second output tensor of the topK layer. The data type of the second output tensor of the topK layer is always Int32. Also the output type of all layers that are shape operations must be DataType::kINT32, and all attempts to set the output type to some other data type will be ignored except for issuing an error message.
index | the index of the output to set |
dataType | the type of the output |
|
pure virtual |
Set the computational precision of this layer.
Setting the precision allows TensorRT to choose implementation which run at this computational precision. Layer input type would also get inferred from layer computational precision. TensorRT could still choose a non-conforming fastest implementation ignoring set layer precision. Use BuilderFlag::kSTRICT_TYPES to force choose implementations with requested precision. In case no implementation is found with requested precision, TensorRT would choose available fastest implementation. If precision is not set, TensorRT will select the layer computational precision and layer input type based on performance considerations and the flags specified to the builder.
precision | the computational precision. |