Data Structures | |
class | BackendContext |
Abstract interface for managing the actual inferencing implementation. More... | |
class | BaseModelParser |
ModelParser base. More... | |
struct | BuildParams |
Holds build parameters common to implicit batch dimension/full dimension networks. More... | |
class | CaffeModelParser |
Implementation of ModelParser for caffemodels derived from BaseModelParser. More... | |
class | ClassifyPostprocessor |
Implementation of post-processing class for classification networks. More... | |
class | CudaBuffer |
Helper base class for managing Cuda allocated buffers. More... | |
class | CudaDeviceBuffer |
CUDA device buffers. More... | |
class | CudaEvent |
Helper class for managing Cuda events. More... | |
class | CudaHostBuffer |
CUDA host buffers. More... | |
class | CudaStream |
Helper class for managing Cuda Streams. More... | |
class | CustomModelParser |
Implementation of ModelParser for custom models. More... | |
class | DetectPostprocessor |
Implementation of post-processing class for object detection networks. More... | |
class | DlaFullDimTrtBackendContext |
Backend context for implicit batch dimension network inferencing on DLA. More... | |
class | DlaImplicitTrtBackendContext |
Backend context for implicit batch dimension network inferencing on DLA. More... | |
class | DlLibHandle |
struct | ExplicitBuildParams |
Holds build parameters required for full dimensions network. More... | |
class | FullDimTrtBackendContext |
Backend context for full dimensions network. More... | |
class | GuardQueue |
struct | ImplicitBuildParams |
Holds build parameters required for implicit batch dimension network. More... | |
class | ImplicitTrtBackendContext |
Backend context for implicit batch dimension network. More... | |
class | InferBatchBuffer |
Abstract interface to manage a batched buffer for inference. More... | |
class | InferPostprocessor |
Base class for post-processing on inference output. More... | |
class | InferPreprocessor |
Provides pre-processing functionality like mean subtraction and normalization. More... | |
class | InstanceSegmentPostprocessor |
Implementation of post-processing class for instance segmentation networks. More... | |
struct | NvDsInferBatch |
Holds information for one batch for processing. More... | |
class | NvDsInferContextImpl |
Implementation of the INvDsInferContext interface. More... | |
class | OnnxModelParser |
Implementation of ModelParser for ONNX models derived from BaseModelParser. More... | |
class | OtherPostprocessor |
class | SegmentPostprocessor |
Implementation of post-processing class for segmentation networks. More... | |
class | SharedPtrWDestroy |
class | TrtBackendContext |
Base class for implementations of the BackendContext interface. More... | |
class | TrtEngine |
Helper class written on top of nvinfer1::ICudaEngine. More... | |
class | TrtModelBuilder |
Helper class to build models and generate the TensorRT ICudaEngine required for inference. More... | |
class | UffModelParser |
Implementation of ModelParser for UFF models derived from BaseModelParser. More... | |
class | UniquePtrWDestroy |
Typedefs | |
using | NvDsInferCudaEngineGetFcnDeprecated = decltype(&NvDsInferCudaEngineGet) |
using | ProfileDims = std::array< nvinfer1::Dims, nvinfer1::EnumMax< nvinfer1::OptProfileSelector >()> |
using | NvDsInferLoggingFunc = std::function< void(NvDsInferLogLevel, const char *msg)> |
Functions | |
std::unique_ptr< TrtBackendContext > | createBackendContext (const std::shared_ptr< TrtEngine > &engine) |
Create an instance of a BackendContext. More... | |
const char * | safeStr (const char *str) |
const char * | safeStr (const std::string &str) |
bool | string_empty (const char *str) |
bool | file_accessible (const char *path) |
bool | file_accessible (const std::string &path) |
std::string | dims2Str (const nvinfer1::Dims &d) |
std::string | dims2Str (const NvDsInferDims &d) |
std::string | batchDims2Str (const NvDsInferBatchDims &d) |
std::string | dataType2Str (const nvinfer1::DataType type) |
std::string | dataType2Str (const NvDsInferDataType type) |
std::string | networkMode2Str (const NvDsInferNetworkMode type) |
uint32_t | getElementSize (NvDsInferDataType t) |
Get the size of the element from the data type. More... | |
nvinfer1::Dims | ds2TrtDims (const NvDsInferDimsCHW &dims) |
nvinfer1::Dims | ds2TrtDims (const NvDsInferDims &dims) |
NvDsInferDims | trt2DsDims (const nvinfer1::Dims &dims) |
nvinfer1::Dims | CombineDimsBatch (const NvDsInferDims &dims, int batch) |
void | SplitFullDims (const nvinfer1::Dims &fullDims, NvDsInferDims &dims, int &batch) |
void | convertFullDims (const nvinfer1::Dims &fullDims, NvDsInferBatchDims &batchDims) |
void | normalizeDims (NvDsInferDims &dims) |
bool | hasWildcard (const nvinfer1::Dims &dims) |
bool | hasWildcard (const NvDsInferDims &dims) |
bool | operator<= (const nvinfer1::Dims &a, const nvinfer1::Dims &b) |
bool | operator> (const nvinfer1::Dims &a, const nvinfer1::Dims &b) |
bool | operator== (const nvinfer1::Dims &a, const nvinfer1::Dims &b) |
bool | operator!= (const nvinfer1::Dims &a, const nvinfer1::Dims &b) |
bool | operator<= (const NvDsInferDims &a, const NvDsInferDims &b) |
bool | operator> (const NvDsInferDims &a, const NvDsInferDims &b) |
bool | operator== (const NvDsInferDims &a, const NvDsInferDims &b) |
bool | operator!= (const NvDsInferDims &a, const NvDsInferDims &b) |
bool | isValidOutputFormat (const std::string &fmt) |
bool | isValidOutputDataType (const std::string &dataType) |
nvinfer1::DataType | str2DataType (const std::string &dataType) |
uint32_t | str2TensorFormat (const std::string &fmt) |
bool | validateIOTensorNames (const BuildParams ¶ms, const nvinfer1::INetworkDefinition &network) |
bool | isValidDeviceType (const std::string &fmt) |
bool | isValidPrecisionType (const std::string &dataType) |
nvinfer1::DataType | str2PrecisionType (const std::string &dataType) |
nvinfer1::DeviceType | str2DeviceType (const std::string &deviceType) |
void | dsInferLogPrint__ (NvDsInferLogLevel level, const char *fmt,...) |
Print the nvinferserver log messages as per the configured log level. More... | |
Variables | |
static const size_t | kWorkSpaceSize = 450 * 1024 * 1024 |
using nvdsinfer::NvDsInferCudaEngineGetFcnDeprecated = typedef decltype(&NvDsInferCudaEngineGet) |
Definition at line 44 of file nvdsinfer_model_builder.h.
using nvdsinfer::NvDsInferLoggingFunc = typedef std::function<void(NvDsInferLogLevel, const char* msg)> |
Definition at line 49 of file nvdsinfer_context_impl.h.
using nvdsinfer::ProfileDims = typedef std::array<nvinfer1::Dims, nvinfer1::EnumMax<nvinfer1::OptProfileSelector>()> |
Definition at line 232 of file nvdsinfer_model_builder.h.
std::string nvdsinfer::batchDims2Str | ( | const NvDsInferBatchDims & | d | ) |
nvinfer1::Dims nvdsinfer::CombineDimsBatch | ( | const NvDsInferDims & | dims, |
int | batch | ||
) |
|
inline |
Definition at line 243 of file nvdsinfer_func_utils.h.
References INFER_EXPORT_API::fullDims(), and SplitFullDims().
std::unique_ptr<TrtBackendContext> nvdsinfer::createBackendContext | ( | const std::shared_ptr< TrtEngine > & | engine | ) |
Create an instance of a BackendContext.
ImplicitTrtBackendContext - created when TRT CudaEngine/network is built with implicit batch dimensions FullDimTrtBackendContext - created when TRT CudaEngine/network is built with full dimensions support DlaTrtBackendContext - created when TRT CudaEngine is built for DLA
std::string nvdsinfer::dataType2Str | ( | const NvDsInferDataType | type | ) |
std::string nvdsinfer::dataType2Str | ( | const nvinfer1::DataType | type | ) |
std::string nvdsinfer::dims2Str | ( | const NvDsInferDims & | d | ) |
std::string nvdsinfer::dims2Str | ( | const nvinfer1::Dims & | d | ) |
nvinfer1::Dims nvdsinfer::ds2TrtDims | ( | const NvDsInferDims & | dims | ) |
nvinfer1::Dims nvdsinfer::ds2TrtDims | ( | const NvDsInferDimsCHW & | dims | ) |
|
inline |
Print the nvinferserver log messages as per the configured log level.
Definition at line 27 of file infer_options.h.
|
inline |
Definition at line 96 of file nvdsinfer_func_utils.h.
Referenced by file_accessible().
|
inline |
Definition at line 102 of file nvdsinfer_func_utils.h.
References file_accessible().
|
inline |
Get the size of the element from the data type.
Definition at line 209 of file nvdsinfer_func_utils.h.
References dsInferError, FLOAT, HALF, INT32, and INT8.
bool nvdsinfer::hasWildcard | ( | const NvDsInferDims & | dims | ) |
bool nvdsinfer::hasWildcard | ( | const nvinfer1::Dims & | dims | ) |
bool nvdsinfer::isValidDeviceType | ( | const std::string & | fmt | ) |
bool nvdsinfer::isValidOutputDataType | ( | const std::string & | dataType | ) |
bool nvdsinfer::isValidOutputFormat | ( | const std::string & | fmt | ) |
bool nvdsinfer::isValidPrecisionType | ( | const std::string & | dataType | ) |
std::string nvdsinfer::networkMode2Str | ( | const NvDsInferNetworkMode | type | ) |
void nvdsinfer::normalizeDims | ( | NvDsInferDims & | dims | ) |
bool nvdsinfer::operator!= | ( | const NvDsInferDims & | a, |
const NvDsInferDims & | b | ||
) |
bool nvdsinfer::operator!= | ( | const nvinfer1::Dims & | a, |
const nvinfer1::Dims & | b | ||
) |
bool nvdsinfer::operator<= | ( | const NvDsInferDims & | a, |
const NvDsInferDims & | b | ||
) |
bool nvdsinfer::operator<= | ( | const nvinfer1::Dims & | a, |
const nvinfer1::Dims & | b | ||
) |
bool nvdsinfer::operator== | ( | const NvDsInferDims & | a, |
const NvDsInferDims & | b | ||
) |
bool nvdsinfer::operator== | ( | const nvinfer1::Dims & | a, |
const nvinfer1::Dims & | b | ||
) |
bool nvdsinfer::operator> | ( | const NvDsInferDims & | a, |
const NvDsInferDims & | b | ||
) |
bool nvdsinfer::operator> | ( | const nvinfer1::Dims & | a, |
const nvinfer1::Dims & | b | ||
) |
|
inline |
Definition at line 81 of file nvdsinfer_func_utils.h.
Referenced by nvdsinfer::CustomModelParser::getModelName().
|
inline |
Definition at line 86 of file nvdsinfer_func_utils.h.
void nvdsinfer::SplitFullDims | ( | const nvinfer1::Dims & | fullDims, |
NvDsInferDims & | dims, | ||
int & | batch | ||
) |
Referenced by convertFullDims().
nvinfer1::DataType nvdsinfer::str2DataType | ( | const std::string & | dataType | ) |
nvinfer1::DeviceType nvdsinfer::str2DeviceType | ( | const std::string & | deviceType | ) |
nvinfer1::DataType nvdsinfer::str2PrecisionType | ( | const std::string & | dataType | ) |
uint32_t nvdsinfer::str2TensorFormat | ( | const std::string & | fmt | ) |
|
inline |
Definition at line 91 of file nvdsinfer_func_utils.h.
Referenced by nvdsinfer::DlLibHandle::symbol().
NvDsInferDims nvdsinfer::trt2DsDims | ( | const nvinfer1::Dims & | dims | ) |
bool nvdsinfer::validateIOTensorNames | ( | const BuildParams & | params, |
const nvinfer1::INetworkDefinition & | network | ||
) |
|
static |
Definition at line 46 of file nvdsinfer_model_builder.h.