NVIDIA DeepStream SDK API Reference
6.4 Release
Public Member Functions | Protected Member Functions | Protected Attributes | Static Protected Attributes
nvdsinfer::ImplicitTrtBackendContext Class Reference

Detailed Description

Backend context for implicit batch dimension network.

Definition at line 258 of file nvdsinfer_backend.h.

Inheritance diagram for nvdsinfer::ImplicitTrtBackendContext:
Inheritance graph
[legend]
Collaboration diagram for nvdsinfer::ImplicitTrtBackendContext:
Collaboration graph
[legend]

Public Member Functions

 ImplicitTrtBackendContext (UniquePtrWDestroy< nvinfer1::IExecutionContext > &&ctx, std::shared_ptr< TrtEngine > engine)
 

Protected Member Functions

bool canSupportBatchDims (int bindingIdx, const NvDsInferBatchDims &batchDims) override
 
int getLayerIdx (const std::string &bindingName) override
 
int getNumBoundLayers () override
 
const NvDsInferBatchDimsLayerInfo & getLayerInfo (int bindingIdx) override
 
virtual NvDsInferBatchDims getMaxBatchDims (int bindingIdx) override
 
virtual NvDsInferBatchDims getMinBatchDims (int bindingIdx) override
 
virtual NvDsInferBatchDims getOptBatchDims (int bindingIdx) override
 

Protected Attributes

int m_MaxBatchSize = 0
 
UniquePtrWDestroy< nvinfer1::IExecutionContext > m_Context
 
std::shared_ptr< TrtEngine > m_CudaEngine
 
std::vector< NvDsInferBatchDimsLayerInfo > m_AllLayers
 
int m_GpuId = -1
 

Static Protected Attributes

static std::mutex sDLAExecutionMutex
 

Constructor & Destructor Documentation

◆ ImplicitTrtBackendContext()

nvdsinfer::ImplicitTrtBackendContext::ImplicitTrtBackendContext ( UniquePtrWDestroy< nvinfer1::IExecutionContext > &&  ctx,
std::shared_ptr< TrtEngine >  engine 
)

Member Function Documentation

◆ canSupportBatchDims()

bool nvdsinfer::ImplicitTrtBackendContext::canSupportBatchDims ( int  bindingIdx,
const NvDsInferBatchDims &  batchDims 
)
overrideprotectedvirtual

Reimplemented from nvdsinfer::TrtBackendContext.

◆ getLayerIdx()

int nvdsinfer::TrtBackendContext::getLayerIdx ( const std::string &  bindingName)
overrideprotectedvirtualinherited

Implements nvdsinfer::BackendContext.

◆ getLayerInfo()

const NvDsInferBatchDimsLayerInfo& nvdsinfer::TrtBackendContext::getLayerInfo ( int  bindingIdx)
inlineoverrideprotectedvirtualinherited

Implements nvdsinfer::BackendContext.

Definition at line 220 of file nvdsinfer_backend.h.

References nvdsinfer::TrtBackendContext::m_AllLayers.

◆ getMaxBatchDims()

virtual NvDsInferBatchDims nvdsinfer::TrtBackendContext::getMaxBatchDims ( int  bindingIdx)
inlineoverrideprotectedvirtualinherited

Implements nvdsinfer::BackendContext.

Definition at line 229 of file nvdsinfer_backend.h.

References nvdsinfer::TrtBackendContext::m_AllLayers.

◆ getMinBatchDims()

virtual NvDsInferBatchDims nvdsinfer::TrtBackendContext::getMinBatchDims ( int  bindingIdx)
inlineoverrideprotectedvirtualinherited

Implements nvdsinfer::BackendContext.

Definition at line 234 of file nvdsinfer_backend.h.

References nvdsinfer::TrtBackendContext::m_AllLayers.

◆ getNumBoundLayers()

int nvdsinfer::TrtBackendContext::getNumBoundLayers ( )
overrideprotectedvirtualinherited

Implements nvdsinfer::BackendContext.

◆ getOptBatchDims()

virtual NvDsInferBatchDims nvdsinfer::TrtBackendContext::getOptBatchDims ( int  bindingIdx)
inlineoverrideprotectedvirtualinherited

Implements nvdsinfer::BackendContext.

Definition at line 239 of file nvdsinfer_backend.h.

References nvdsinfer::TrtBackendContext::m_AllLayers.

Field Documentation

◆ m_AllLayers

std::vector<NvDsInferBatchDimsLayerInfo> nvdsinfer::TrtBackendContext::m_AllLayers
protectedinherited

Definition at line 248 of file nvdsinfer_backend.h.

Referenced by nvdsinfer::TrtBackendContext::getLayerInfo(), nvdsinfer::TrtBackendContext::getMaxBatchDims(), nvdsinfer::TrtBackendContext::getMinBatchDims(), and nvdsinfer::TrtBackendContext::getOptBatchDims().

◆ m_Context

UniquePtrWDestroy<nvinfer1::IExecutionContext> nvdsinfer::TrtBackendContext::m_Context
protectedinherited

Definition at line 246 of file nvdsinfer_backend.h.

◆ m_CudaEngine

std::shared_ptr<TrtEngine> nvdsinfer::TrtBackendContext::m_CudaEngine
protectedinherited

Definition at line 247 of file nvdsinfer_backend.h.

◆ m_GpuId

int nvdsinfer::TrtBackendContext::m_GpuId = -1
protectedinherited

Definition at line 250 of file nvdsinfer_backend.h.

◆ m_MaxBatchSize

int nvdsinfer::ImplicitTrtBackendContext::m_MaxBatchSize = 0
protected

Definition at line 276 of file nvdsinfer_backend.h.

◆ sDLAExecutionMutex

std::mutex nvdsinfer::TrtBackendContext::sDLAExecutionMutex
staticprotectedinherited

Definition at line 252 of file nvdsinfer_backend.h.

The documentation for this class was generated from the following file: