TensorRT 11.2.1
nvinfer2::safe::IPluginV3OneSafeRuntime Class Referenceabstract

Runtime component of the pluginV3 system. More...

#include <NvInferSafePlugin.h>

Inheritance diagram for nvinfer2::safe::IPluginV3OneSafeRuntime:
nvinfer1::v_1_0::IPluginCapability nvinfer1::IVersionedInterface

Public Member Functions

InterfaceInfo getInterfaceInfo () const noexcept override
 Return version information associated with this interface. Applications must not override this method. More...
 
 IPluginV3OneSafeRuntime (IPluginV3OneSafeRuntime const &)=default
 Copy constructor. More...
 
 IPluginV3OneSafeRuntime (IPluginV3OneSafeRuntime &&)=default
 Move constructor. More...
 
IPluginV3OneSafeRuntimeoperator= (IPluginV3OneSafeRuntime const &) &=default
 Copy assignment operator. More...
 
IPluginV3OneSafeRuntimeoperator= (IPluginV3OneSafeRuntime &&) &=default
 Move assignment operator. More...
 
 ~IPluginV3OneSafeRuntime () noexcept override=default
 Destructor for IPluginV3OneSafeRuntime. More...
 
virtual int32_t setTactic (int32_t) noexcept
 Set the tactic to be used in the subsequent call to enqueue(). If no custom tactics were advertised, this will have a value of 0, which is designated as the default tactic. More...
 
virtual int32_t enqueue (TensorDescriptor const *inputDesc, TensorDescriptor const *outputDesc, void const *const *inputs, void *const *outputs, void *workspace, cudaStream_t stream) noexcept=0
 Execute the layer. More...
 
virtual int32_t initResource (ISafePluginResourceContext const *context) noexcept=0
 This function will be called to initialize a plugin object after it is created (before execution phase), either during graph deserialization or when the graph is cloned. The overriding implementations of this function can use the provided context object to access the message recorder, the memory allocator and the runtime error buffer of the graph context to which this plugin belongs. More...
 
virtual IPluginV3clone () noexcept=0
 Clone the plugin object. This copies over internal plugin parameters and returns a new plugin object with these parameters. This call will always be followed by a call to initResource() to complete any initializations that depend on the graph context. More...
 
virtual PluginFieldCollection const * getFieldsToSerialize () noexcept=0
 Get the plugin fields which should be serialized. More...
 
- Public Member Functions inherited from nvinfer1::IVersionedInterface
virtual APILanguage getAPILanguage () const noexcept
 The language used to build the implementation of this Interface. More...
 
virtual ~IVersionedInterface () noexcept=default
 

Protected Member Functions

 IPluginV3OneSafeRuntime ()=default
 Default constructor. More...
 
- Protected Member Functions inherited from nvinfer1::IVersionedInterface
 IVersionedInterface ()=default
 
 IVersionedInterface (IVersionedInterface const &)=default
 
 IVersionedInterface (IVersionedInterface &&)=default
 
IVersionedInterfaceoperator= (IVersionedInterface const &) &=default
 
IVersionedInterfaceoperator= (IVersionedInterface &&) &=default
 

Detailed Description

Runtime component of the pluginV3 system.

Constructor & Destructor Documentation

◆ IPluginV3OneSafeRuntime() [1/3]

nvinfer2::safe::IPluginV3OneSafeRuntime::IPluginV3OneSafeRuntime ( IPluginV3OneSafeRuntime const &  )
default

Copy constructor.

◆ IPluginV3OneSafeRuntime() [2/3]

nvinfer2::safe::IPluginV3OneSafeRuntime::IPluginV3OneSafeRuntime ( IPluginV3OneSafeRuntime &&  )
default

Move constructor.

◆ ~IPluginV3OneSafeRuntime()

nvinfer2::safe::IPluginV3OneSafeRuntime::~IPluginV3OneSafeRuntime ( )
overridedefaultnoexcept

Destructor for IPluginV3OneSafeRuntime.

◆ IPluginV3OneSafeRuntime() [3/3]

nvinfer2::safe::IPluginV3OneSafeRuntime::IPluginV3OneSafeRuntime ( )
protecteddefault

Default constructor.

Member Function Documentation

◆ clone()

virtual IPluginV3 * nvinfer2::safe::IPluginV3OneSafeRuntime::clone ( )
pure virtualnoexcept

Clone the plugin object. This copies over internal plugin parameters and returns a new plugin object with these parameters. This call will always be followed by a call to initResource() to complete any initializations that depend on the graph context.

Precondition
INIT API

◆ enqueue()

virtual int32_t nvinfer2::safe::IPluginV3OneSafeRuntime::enqueue ( TensorDescriptor const *  inputDesc,
TensorDescriptor const *  outputDesc,
void const *const *  inputs,
void *const *  outputs,
void *  workspace,
cudaStream_t  stream 
)
pure virtualnoexcept

Execute the layer.

Precondition
RUNTIME API
Parameters
inputDeschow to interpret the memory for the input tensors.
outputDeschow to interpret the memory for the output tensors.
inputsThe memory for the input tensors.
outputsThe memory for the output tensors.
workspaceWorkspace for execution.
streamThe stream in which to execute the kernels.
Returns
0 for success, else non-zero (which will cause engine termination). The returned code will be reported through the error recorder.

◆ getFieldsToSerialize()

virtual PluginFieldCollection const * nvinfer2::safe::IPluginV3OneSafeRuntime::getFieldsToSerialize ( )
pure virtualnoexcept

Get the plugin fields which should be serialized.

Precondition
INIT API
Note
The set of plugin fields returned does not necessarily need to match that advertised through getFieldNames() of the corresponding plugin creator.
To serialize arbitrary plugin data, use a PluginField of PluginFieldType::kUNKNOWN, with the length of the PluginField set to the correct number of bytes.

◆ getInterfaceInfo()

InterfaceInfo nvinfer2::safe::IPluginV3OneSafeRuntime::getInterfaceInfo ( ) const
inlineoverridevirtualnoexcept

Return version information associated with this interface. Applications must not override this method.

Precondition
INIT API

Implements nvinfer1::IVersionedInterface.

◆ initResource()

virtual int32_t nvinfer2::safe::IPluginV3OneSafeRuntime::initResource ( ISafePluginResourceContext const *  context)
pure virtualnoexcept

This function will be called to initialize a plugin object after it is created (before execution phase), either during graph deserialization or when the graph is cloned. The overriding implementations of this function can use the provided context object to access the message recorder, the memory allocator and the runtime error buffer of the graph context to which this plugin belongs.

Precondition
INIT API
Parameters
ISafePluginResourceContextA pointer to the ISafePluginResourceContext which contains the message recorder, the memory allocator, and the runtime error information buffer.
Returns
0 for success, else non-zero (which will cause engine termination). The returned code will be reported through the error recorder.

◆ operator=() [1/2]

IPluginV3OneSafeRuntime & nvinfer2::safe::IPluginV3OneSafeRuntime::operator= ( IPluginV3OneSafeRuntime &&  ) &
default

Move assignment operator.

◆ operator=() [2/2]

IPluginV3OneSafeRuntime & nvinfer2::safe::IPluginV3OneSafeRuntime::operator= ( IPluginV3OneSafeRuntime const &  ) &
default

Copy assignment operator.

◆ setTactic()

virtual int32_t nvinfer2::safe::IPluginV3OneSafeRuntime::setTactic ( int32_t  )
inlinevirtualnoexcept

Set the tactic to be used in the subsequent call to enqueue(). If no custom tactics were advertised, this will have a value of 0, which is designated as the default tactic.

Precondition
INIT API
Returns
0 for success, else non-zero (which will cause engine termination). The returned code will be reported through the error recorder.

The documentation for this class was generated from the following file:

  Copyright © 2024 NVIDIA Corporation
  Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact