NVIDIA DeepStream SDK API Reference
7.0 Release
Public Member Functions
nvdsinfer::BackendContext Class Referenceabstract

Detailed Description

Abstract interface for managing the actual inferencing implementation.

This interface abstracts away the low-level implementation details required for inferencing with implicit batch dimensions network/full dimensions network on GPU and inferencing on DLA.

Actual instance of a BackendContext can be created using createBackendContext function. This function will create the appropriate BackendContext (ImplicitTrtBackendContext/FullDimTrtBackendContext/DlaTrtBackendContext) based on the parameters used to build the network/engine.

Definition at line 168 of file nvdsinfer_backend.h.

Inheritance diagram for nvdsinfer::BackendContext:
Inheritance graph
[legend]

Public Member Functions

 BackendContext ()=default
 
virtual ~BackendContext ()=default
 
virtual NvDsInferStatus initialize ()=0
 
virtual int getNumBoundLayers ()=0
 
virtual const NvDsInferBatchDimsLayerInfo & getLayerInfo (int bindingIdx)=0
 
virtual int getLayerIdx (const std::string &bindingName)=0
 
virtual bool canSupportBatchDims (int bindingIdx, const NvDsInferBatchDims &batchDims)=0
 
virtual NvDsInferBatchDims getMaxBatchDims (int bindingIdx)=0
 
virtual NvDsInferBatchDims getMinBatchDims (int bindingIdx)=0
 
virtual NvDsInferBatchDims getOptBatchDims (int bindingIdx)=0
 
virtual NvDsInferStatus enqueueBuffer (const std::shared_ptr< InferBatchBuffer > &buffer, CudaStream &stream, CudaEvent *consumeEvent)=0
 

Constructor & Destructor Documentation

◆ BackendContext()

nvdsinfer::BackendContext::BackendContext ( )
default

◆ ~BackendContext()

virtual nvdsinfer::BackendContext::~BackendContext ( )
virtualdefault

Member Function Documentation

◆ canSupportBatchDims()

virtual bool nvdsinfer::BackendContext::canSupportBatchDims ( int  bindingIdx,
const NvDsInferBatchDims &  batchDims 
)
pure virtual

Implemented in nvdsinfer::ImplicitTrtBackendContext, and nvdsinfer::TrtBackendContext.

◆ enqueueBuffer()

virtual NvDsInferStatus nvdsinfer::BackendContext::enqueueBuffer ( const std::shared_ptr< InferBatchBuffer > &  buffer,
CudaStream &  stream,
CudaEvent *  consumeEvent 
)
pure virtual

Implemented in nvdsinfer::DlaFullDimTrtBackendContext, and nvdsinfer::DlaImplicitTrtBackendContext.

◆ getLayerIdx()

virtual int nvdsinfer::BackendContext::getLayerIdx ( const std::string &  bindingName)
pure virtual

Implemented in nvdsinfer::TrtBackendContext.

◆ getLayerInfo()

virtual const NvDsInferBatchDimsLayerInfo& nvdsinfer::BackendContext::getLayerInfo ( int  bindingIdx)
pure virtual

Implemented in nvdsinfer::TrtBackendContext.

◆ getMaxBatchDims()

virtual NvDsInferBatchDims nvdsinfer::BackendContext::getMaxBatchDims ( int  bindingIdx)
pure virtual

Implemented in nvdsinfer::TrtBackendContext.

◆ getMinBatchDims()

virtual NvDsInferBatchDims nvdsinfer::BackendContext::getMinBatchDims ( int  bindingIdx)
pure virtual

Implemented in nvdsinfer::TrtBackendContext.

◆ getNumBoundLayers()

virtual int nvdsinfer::BackendContext::getNumBoundLayers ( )
pure virtual

Implemented in nvdsinfer::TrtBackendContext.

◆ getOptBatchDims()

virtual NvDsInferBatchDims nvdsinfer::BackendContext::getOptBatchDims ( int  bindingIdx)
pure virtual

Implemented in nvdsinfer::TrtBackendContext.

◆ initialize()

virtual NvDsInferStatus nvdsinfer::BackendContext::initialize ( )
pure virtual
The documentation for this class was generated from the following file: