TensorRT 8.4.0
|
Go to the source code of this file.
Classes | |
class | nvinfer1::INoCopy |
Forward declaration of IEngineInspector for use by other interfaces. More... | |
struct | nvinfer1::impl::EnumMaxImpl< EngineCapability > |
Maximum number of elements in EngineCapability enum. More... | |
class | nvinfer1::Weights |
An array of weights used as a layer parameter. More... | |
class | nvinfer1::IHostMemory |
Class to handle library allocated memory that is accessible to the user. More... | |
struct | nvinfer1::impl::EnumMaxImpl< TensorLocation > |
Maximum number of elements in TensorLocation enum. More... | |
class | nvinfer1::IDimensionExpr |
class | nvinfer1::IExprBuilder |
class | nvinfer1::DimsExprs |
class | nvinfer1::DynamicPluginTensorDesc |
class | nvinfer1::IPluginV2DynamicExt |
class | nvinfer1::IProfiler |
Application-implemented interface for profiling. More... | |
class | nvinfer1::IRuntime |
Allows a serialized functionally unsafe engine to be deserialized. More... | |
class | nvinfer1::IRefitter |
Updates weights in an engine. More... | |
class | nvinfer1::IOptimizationProfile |
Optimization profile for dynamic input dimensions and shape tensors. More... | |
class | nvinfer1::ICudaEngine |
An engine for executing inference on a built network, with functionally unsafe features. More... | |
class | nvinfer1::IExecutionContext |
Context for executing inference using an engine, with functionally unsafe features. More... | |
class | nvinfer1::IEngineInspector |
An engine inspector which prints out the layer information of an engine or an execution context. More... | |
class | nvinfer1::PluginRegistrar< T > |
Register the plugin creator to the registry The static registry object will be instantiated when the plugin library is loaded. This static object will register all creators available in the library to the registry. More... | |
Namespaces | |
namespace | nvinfer1 |
The TensorRT API version 1 namespace. | |
namespace | nvinfer1::impl |
Macros | |
#define | REGISTER_TENSORRT_PLUGIN(name) static nvinfer1::PluginRegistrar<name> pluginRegistrar##name {} |
Typedefs | |
using | nvinfer1::TacticSources = uint32_t |
Represents a collection of one or more TacticSource values combine using bitwise-OR operations. More... | |
Enumerations | |
enum class | nvinfer1::EngineCapability : int32_t { nvinfer1::kSTANDARD = 0 , nvinfer1::kDEFAULT = kSTANDARD , nvinfer1::kSAFETY = 1 , nvinfer1::kSAFE_GPU = kSAFETY , nvinfer1::kDLA_STANDALONE = 2 , nvinfer1::kSAFE_DLA = kDLA_STANDALONE } |
List of supported engine capability flows. More... | |
enum class | nvinfer1::DimensionOperation : int32_t { nvinfer1::kSUM = 0 , nvinfer1::kPROD = 1 , nvinfer1::kMAX = 2 , nvinfer1::kMIN = 3 , nvinfer1::kSUB = 4 , nvinfer1::kEQUAL = 5 , nvinfer1::kLESS = 6 , nvinfer1::kFLOOR_DIV = 7 , nvinfer1::kCEIL_DIV = 8 } |
An operation on two IDimensionExpr, which represent integer expressions used in dimension computations. More... | |
enum class | nvinfer1::TensorLocation : int32_t { nvinfer1::kDEVICE = 0 , nvinfer1::kHOST = 1 } |
The location for tensor data storage, device or host. More... | |
enum class | nvinfer1::WeightsRole : int32_t { nvinfer1::kKERNEL = 0 , nvinfer1::kBIAS = 1 , nvinfer1::kSHIFT = 2 , nvinfer1::kSCALE = 3 , nvinfer1::kCONSTANT = 4 , nvinfer1::kANY = 5 } |
How a layer uses particular Weights. More... | |
enum class | nvinfer1::DeviceType : int32_t { nvinfer1::kGPU , nvinfer1::kDLA } |
The device that this layer/network will execute on. More... | |
enum class | nvinfer1::OptProfileSelector : int32_t { nvinfer1::kMIN = 0 , nvinfer1::kOPT = 1 , nvinfer1::kMAX = 2 } |
When setting or querying optimization profile parameters (such as shape tensor inputs or dynamic dimensions), select whether we are interested in the minimum, optimum, or maximum values for these parameters. The minimum and maximum specify the permitted range that is supported at runtime, while the optimum value is used for the kernel selection. This should be the "typical" value that is expected to occur at runtime. More... | |
enum class | nvinfer1::TacticSource : int32_t { nvinfer1::kCUBLAS = 0 , nvinfer1::kCUBLAS_LT = 1 , nvinfer1::kCUDNN = 2 } |
List of tactic sources for TensorRT. More... | |
enum class | nvinfer1::ProfilingVerbosity : int32_t { nvinfer1::kLAYER_NAMES_ONLY = 0 , nvinfer1::kNONE = 1 , nvinfer1::kDETAILED = 2 , nvinfer1::kDEFAULT = kLAYER_NAMES_ONLY , nvinfer1::kVERBOSE = kDETAILED } |
List of verbosity levels of layer information exposed in NVTX annotations and in IEngineInspector. More... | |
enum class | nvinfer1::LayerInformationFormat : int32_t { nvinfer1::kONELINE = 0 , nvinfer1::kJSON = 1 } |
The format in which the IEngineInspector prints the layer information. More... | |
Functions | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< DimensionOperation > () noexcept |
Maximum number of elements in DimensionOperation enum. More... | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< WeightsRole > () noexcept |
Maximum number of elements in WeightsRole enum. More... | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< DeviceType > () noexcept |
Maximum number of elements in DeviceType enum. More... | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< OptProfileSelector > () noexcept |
Number of different values of OptProfileSelector enum. More... | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< TacticSource > () noexcept |
Maximum number of tactic sources in TacticSource enum. More... | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< ProfilingVerbosity > () noexcept |
Maximum number of profile verbosity levels in ProfilingVerbosity enum. More... | |
template<> | |
constexpr int32_t | nvinfer1::EnumMax< LayerInformationFormat > () noexcept |
nvinfer1::IPluginRegistry * | getPluginRegistry () noexcept |
Return the plugin registry. More... | |
nvinfer1::ILogger * | getLogger () noexcept |
Return the logger object. More... | |
This is the top-level API file for TensorRT extended runtime library.
#define REGISTER_TENSORRT_PLUGIN | ( | name | ) | static nvinfer1::PluginRegistrar<name> pluginRegistrar##name {} |
|
noexcept |
Return the logger object.
|
noexcept |
Return the plugin registry.