This class provides build capability and let output shapes be calculated by symbolic expression to support multiple static shape. More...

#include <NvInferSafePlugin.h>

Inheritance diagram for nvinfer2::safe::IPluginV3OneSafeBuildMSS:

Public Member Functions
InterfaceInfo	getInterfaceInfo () const noexcept override
	Return version information associated with this interface. Applications must not override this method. More...

int32_t	getOutputShapes (Dims const , int32_t, Dims , int32_t) const noexcept override
	Provide expressions for computing dimensions of the output tensors from dimensions of the input tensors. More...

	IPluginV3OneSafeBuildMSS (IPluginV3OneSafeBuildMSS const &)=default
	Copy constructor. More...

	IPluginV3OneSafeBuildMSS (IPluginV3OneSafeBuildMSS &&)=delete
	Move constructor. More...

IPluginV3OneSafeBuildMSS &	operator= (IPluginV3OneSafeBuildMSS const &) &=default
	Copy assignment operator. More...

IPluginV3OneSafeBuildMSS &	operator= (IPluginV3OneSafeBuildMSS &&) &=delete
	Move assignment operator. More...

	~IPluginV3OneSafeBuildMSS () noexcept override=default
	Destructor for IPluginV3OneSafeBuildMSS. More...

virtual int32_t	getSymbolicOutputShapes (nvinfer1::DimsExprs const inputs, int32_t nbInputs, nvinfer1::DimsExprs outputs, int32_t nbOutputs, nvinfer1::IExprBuilder &exprBuilder) const noexcept=0
	Provide expressions for computing dimensions of the output tensors from dimensions of the input tensors. More...

Public Member Functions inherited from nvinfer2::safe::IPluginV3OneSafeBuild
	IPluginV3OneSafeBuild ()=default
	Default constructor. More...

	IPluginV3OneSafeBuild (IPluginV3OneSafeBuild &&)=delete
	Deleted move constructor to maintain non-movability. More...

IPluginV3OneSafeBuild &	operator= (IPluginV3OneSafeBuild &&) &=delete
	Deleted move assignment operator to maintain non-movability. More...

	~IPluginV3OneSafeBuild () noexcept override=default
	Destructor for IPluginV3OneSafeBuild. More...

virtual int32_t	configurePlugin (TensorDescriptor const in, int32_t nbInputs, TensorDescriptor const out, int32_t nbOutputs) noexcept=0
	Configure the plugin. More...

virtual int32_t	getOutputDataTypes (DataType outputTypes, int32_t nbOutputs, DataType const inputTypes, int32_t nbInputs) const noexcept=0
	Provide the data types of the plugin outputs if the input tensors have the data types provided. More...

virtual bool	supportsFormatCombination (int32_t pos, TensorDescriptor const *inOut, int32_t nbInputs, int32_t nbOutputs) noexcept=0
	Return true if plugin supports the format and datatype for the input/output indexed by pos. More...

virtual int32_t	getNbOutputs () const noexcept=0
	Get the number of outputs from the plugin. More...

virtual size_t	getWorkspaceSize (TensorDescriptor const , int32_t, TensorDescriptor const , int32_t) const noexcept
	Find the workspace size required by the layer. More...

virtual int32_t	getValidTactics (int32_t *, int32_t) noexcept
	Query for any custom tactics that the plugin intends to use. More...

virtual int32_t	getNbTactics () noexcept
	Query for the number of custom tactics the plugin intends to use. More...

virtual char const *	getTimingCacheID () noexcept
	Called to query the suffix to use for the timing cache ID. May be called anytime after plugin creation. More...

virtual int32_t	getFormatCombinationLimit () noexcept
	Return the maximum number of format combinations that will be timed by TensorRT during the build phase. More...

virtual char const *	getMetadataString () noexcept
	Query for a string representing the configuration of the plugin. May be called anytime after plugin creation. More...

Public Member Functions inherited from nvinfer1::IVersionedInterface
virtual APILanguage	getAPILanguage () const noexcept
	The language used to build the implementation of this Interface. More...

virtual	~IVersionedInterface () noexcept=default

Protected Member Functions
	IPluginV3OneSafeBuildMSS ()=default
	Default constructor. More...

Protected Member Functions inherited from nvinfer2::safe::IPluginV3OneSafeBuild
	IPluginV3OneSafeBuild (IPluginV3OneSafeBuild const &)=default

IPluginV3OneSafeBuild &	operator= (IPluginV3OneSafeBuild const &) &=default

Protected Member Functions inherited from nvinfer1::IVersionedInterface
	IVersionedInterface ()=default

	IVersionedInterface (IVersionedInterface const &)=default

	IVersionedInterface (IVersionedInterface &&)=default

IVersionedInterface &	operator= (IVersionedInterface const &) &=default

IVersionedInterface &	operator= (IVersionedInterface &&) &=default

Additional Inherited Members
Static Public Attributes inherited from nvinfer2::safe::IPluginV3OneSafeBuild
static constexpr int32_t	kDEFAULT_FORMAT_COMBINATION_LIMIT = 100
	Default maximum number of format combinations timed by TensorRT during the build phase. More...

Detailed Description

This class provides build capability and let output shapes be calculated by symbolic expression to support multiple static shape.

Constructor & Destructor Documentation

◆ IPluginV3OneSafeBuildMSS() [1/3]

nvinfer2::safe::IPluginV3OneSafeBuildMSS::IPluginV3OneSafeBuildMSS ( IPluginV3OneSafeBuildMSS const & )

default

Copy constructor.

◆ IPluginV3OneSafeBuildMSS() [2/3]

nvinfer2::safe::IPluginV3OneSafeBuildMSS::IPluginV3OneSafeBuildMSS ( IPluginV3OneSafeBuildMSS && )

delete

Move constructor.

◆ ~IPluginV3OneSafeBuildMSS()

nvinfer2::safe::IPluginV3OneSafeBuildMSS::~IPluginV3OneSafeBuildMSS ( )

overridedefaultnoexcept

Destructor for IPluginV3OneSafeBuildMSS.

◆ IPluginV3OneSafeBuildMSS() [3/3]

nvinfer2::safe::IPluginV3OneSafeBuildMSS::IPluginV3OneSafeBuildMSS ( )

protecteddefault

Default constructor.

Member Function Documentation

◆ getInterfaceInfo()

InterfaceInfo nvinfer2::safe::IPluginV3OneSafeBuildMSS::getInterfaceInfo ( ) const

inlineoverridevirtualnoexcept

Return version information associated with this interface. Applications must not override this method.

Reimplemented from nvinfer2::safe::IPluginV3OneSafeBuild.

◆ getOutputShapes()

int32_t nvinfer2::safe::IPluginV3OneSafeBuildMSS::getOutputShapes	(	Dims const *	inputs,
		int32_t	nbInputs,
		Dims *	outputs,
		int32_t	nbOutputs
	)		const

inlineoverridevirtualnoexcept

Provide expressions for computing dimensions of the output tensors from dimensions of the input tensors.

Parameters

inputs	Expressions for dimensions of the input tensors
nbInputs	The number of input tensors
shapeInputs	Expressions for values of the shape tensor inputs
nbShapeInputs	The number of shape tensor inputs
outputs	Pre-allocated array to which the output dimensions must be written
exprBuilder	Object for generating new dimension expressions

Note: Any size tensor outputs must be declared to be 0-D.; The declaration of shapeInputs as DimsExprs is slightly abusive, because the "dimensions" are actually the values of the shape tensor. For example, if the input shape tensor is a 2x3 matrix, the DimsExprs will have six "dimensions": the three values from the first row of the matrix followed by the three values from the second row of the matrix.

Returns: 0 for success, else non-zero (which will cause engine termination). Returned code will be reported through the error recorder.

Implements nvinfer2::safe::IPluginV3OneSafeBuild.

◆ getSymbolicOutputShapes()

virtual int32_t nvinfer2::safe::IPluginV3OneSafeBuildMSS::getSymbolicOutputShapes	(	nvinfer1::DimsExprs const *	inputs,
		int32_t	nbInputs,
		nvinfer1::DimsExprs *	outputs,
		int32_t	nbOutputs,
		nvinfer1::IExprBuilder &	exprBuilder
	)		const

pure virtualnoexcept

Provide expressions for computing dimensions of the output tensors from dimensions of the input tensors.

Parameters

inputs	Expressions for dimensions of the input tensors
nbInputs	The number of input tensors
outputs	Pre-allocated array to which the output dimensions must be written
nbOutputs	The number of output tensors
exprBuilder	Object for generating new dimension expressions

Note: Any size tensor outputs must be declared to be 0-D.

Returns: 0 for success, else non-zero (which will cause engine termination). Returned code will be reported through the error recorder.

◆ operator=() [1/2]

IPluginV3OneSafeBuildMSS & nvinfer2::safe::IPluginV3OneSafeBuildMSS::operator= ( IPluginV3OneSafeBuildMSS && ) &

delete

Move assignment operator.

◆ operator=() [2/2]

IPluginV3OneSafeBuildMSS & nvinfer2::safe::IPluginV3OneSafeBuildMSS::operator= ( IPluginV3OneSafeBuildMSS const & ) &