The safety subset of TensorRT's API version 1 namespace. More...

Classes
class	ICudaEngine
	A functionally safe engine for executing inference on a built network. More...

class	IExecutionContext
	Functionally safe context for executing inference using an engine. More...

class	IPluginRegistry
	Single registration point for all plugins in an application. It is used to find plugin implementations during engine deserialization. Internally, the plugin registry is considered to be a singleton so all plugins in an application are part of the same global registry. Note that the plugin registry is only supported for plugins of type IPluginV2 and must also have a corresponding IPluginCreator implementation. More...

class	IRuntime
	Allows a serialized functionally safe engine to be deserialized. More...

class	PluginRegistrar
	Register the plugin creator to the registry The static registry object will be instantiated when the plugin library is loaded. This static object will register all creators available in the library to the registry. More...

struct	RuntimeErrorInformation
	Space to record information about runtime errors. More...

Enumerations
enum class	RuntimeErrorType : uint64_t { kNAN_CONSUMED = 1ULL << 0 , kINF_CONSUMED = 1ULL << 1 , kGATHER_OOB = 1ULL << 2 , kSCATTER_OOB = 1ULL << 3 , kSCATTER_RACE = 1ULL << 4 }
	Enum to represent runtime error types. More...

Functions
IRuntime *	createInferRuntime (ILogger &logger) noexcept
	Create an instance of a safe::IRuntime class. More...

IPluginRegistry *	getSafePluginRegistry () noexcept
	Return the safe plugin registry. More...

Detailed Description

The safety subset of TensorRT's API version 1 namespace.

Enumeration Type Documentation

strong

Enum to represent runtime error types.

Enumerator
kNAN_CONSUMED	NaN floating-point value was silently consumed.
kINF_CONSUMED	Inf floating-point value was silently consumed.
kGATHER_OOB	Out-of-bounds access in gather operation.
kSCATTER_OOB	Out-of-bounds access in scatter operation.
kSCATTER_RACE	Race condition in scatter operation.

IRuntime * nvinfer1::safe::createInferRuntime ( ILogger & logger )

noexcept

Create an instance of a safe::IRuntime class.

Parameters

logger A logger object whose lifetime must exceed that of the returned runtime. Loggers must be thread-safe.

Returns: A safe runtime object that can be used for safe plan file deserialization.

This class is the logging class for the runtime.

Usage considerations

IPluginRegistry * nvinfer1::safe::getSafePluginRegistry ( )

noexcept

Return the safe plugin registry.

Usage considerations