TensorRT 10.6.0
|
#include <NvInferRuntime.h>
Public Member Functions | |
InterfaceInfo | getInterfaceInfo () const noexcept override |
Return version information associated with this interface. Applications must not override this method. More... | |
virtual int32_t | getAliasedInput (int32_t outputIndex) noexcept |
Communicates to TensorRT that the output at the specified output index is aliased to the input at the returned index. More... | |
Public Member Functions inherited from nvinfer1::v_1_0::IPluginV3OneBuild | |
virtual int32_t | configurePlugin (DynamicPluginTensorDesc const *in, int32_t nbInputs, DynamicPluginTensorDesc const *out, int32_t nbOutputs) noexcept=0 |
Configure the plugin. More... | |
virtual int32_t | getOutputDataTypes (DataType *outputTypes, int32_t nbOutputs, const DataType *inputTypes, int32_t nbInputs) const noexcept=0 |
Provide the data types of the plugin outputs if the input tensors have the data types provided. More... | |
virtual int32_t | getOutputShapes (DimsExprs const *inputs, int32_t nbInputs, DimsExprs const *shapeInputs, int32_t nbShapeInputs, DimsExprs *outputs, int32_t nbOutputs, IExprBuilder &exprBuilder) noexcept=0 |
Provide expressions for computing dimensions of the output tensors from dimensions of the input tensors. More... | |
virtual bool | supportsFormatCombination (int32_t pos, DynamicPluginTensorDesc const *inOut, int32_t nbInputs, int32_t nbOutputs) noexcept=0 |
Return true if plugin supports the format and datatype for the input/output indexed by pos. More... | |
virtual int32_t | getNbOutputs () const noexcept=0 |
Get the number of outputs from the plugin. More... | |
virtual size_t | getWorkspaceSize (DynamicPluginTensorDesc const *inputs, int32_t nbInputs, DynamicPluginTensorDesc const *outputs, int32_t nbOutputs) const noexcept |
Find the workspace size required by the layer. More... | |
virtual int32_t | getValidTactics (int32_t *tactics, int32_t nbTactics) noexcept |
Query for any custom tactics that the plugin intends to use. More... | |
virtual int32_t | getNbTactics () noexcept |
Query for the number of custom tactics the plugin intends to use. More... | |
virtual char const * | getTimingCacheID () noexcept |
Called to query the suffix to use for the timing cache ID. May be called anytime after plugin creation. More... | |
virtual int32_t | getFormatCombinationLimit () noexcept |
Return the maximum number of format combinations that will be timed by TensorRT during the build phase. More... | |
virtual char const * | getMetadataString () noexcept |
Query for a string representing the configuration of the plugin. May be called anytime after plugin creation. More... | |
Public Member Functions inherited from nvinfer1::IVersionedInterface | |
virtual APILanguage | getAPILanguage () const noexcept |
The language used to build the implementation of this Interface. More... | |
virtual | ~IVersionedInterface () noexcept=default |
Additional Inherited Members | |
Static Public Attributes inherited from nvinfer1::v_1_0::IPluginV3OneBuild | |
static constexpr int32_t | kDEFAULT_FORMAT_COMBINATION_LIMIT = 100 |
The default maximum number of format combinations that will be timed by TensorRT during the build phase. More... | |
Protected Member Functions inherited from nvinfer1::IVersionedInterface | |
IVersionedInterface ()=default | |
IVersionedInterface (IVersionedInterface const &)=default | |
IVersionedInterface (IVersionedInterface &&)=default | |
IVersionedInterface & | operator= (IVersionedInterface const &) &=default |
IVersionedInterface & | operator= (IVersionedInterface &&) &=default |
|
inlinevirtualnoexcept |
Communicates to TensorRT that the output at the specified output index is aliased to the input at the returned index.
Enables read-modify-write behavior in plugins. TensorRT may insert copies to facilitate this capability.
+-----+ +--------+ +->|Copy +--> t* ---->|Plugin0 +--> t1 | +-----+ +--------+ t | +-----+ +--------+ +->|Copy +--> t** --->|Plugin1 +--> t2 +-----+ +--------+
|
inlineoverridevirtualnoexcept |
Return version information associated with this interface. Applications must not override this method.
Reimplemented from nvinfer1::v_1_0::IPluginV3OneBuild.
Copyright © 2024 NVIDIA Corporation
Privacy Policy |
Manage My Privacy |
Do Not Sell or Share My Data |
Terms of Service |
Accessibility |
Corporate Policies |
Product Security |
Contact