nvdsinferserver::OtherPostprocessor Class Reference

Detailed Description

Post processor class for tensor output for custom post processing.

Definition at line 275 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Inheritance diagram for nvdsinferserver::OtherPostprocessor:

Collaboration diagram for nvdsinferserver::OtherPostprocessor:

Public Types
using	TensorAllocator = std::function< SharedSysMem(const std::string &name, size_t bytes)>
using	TensorAllocator = std::function< SharedSysMem(const std::string &name, size_t bytes)>
using	EventAllocator = std::function< SharedCuEvent()>
using	EventAllocator = std::function< SharedCuEvent()>
using	PostprocessDone = std::function< void(NvDsInferStatus, SharedBatchArray)>
using	PostprocessDone = std::function< void(NvDsInferStatus, SharedBatchArray)>

Public Member Functions
	OtherPostprocessor (int uid, const ic::OtherNetworkParams &params)
	OtherPostprocessor (int uid, const ic::OtherNetworkParams &params)
void	setDllHandle (const SharedDllHandle &dlHandle)
void	setDllHandle (const SharedDllHandle &dlHandle)
void	setLabelPath (const std::string &path)
void	setLabelPath (const std::string &path)
void	setNetworkInfo (const NvDsInferNetworkInfo &info)
void	setNetworkInfo (const NvDsInferNetworkInfo &info)
void	setOutputLayerCount (uint32_t num)
void	setOutputLayerCount (uint32_t num)
void	setInputCopy (bool enable)
void	setInputCopy (bool enable)
const std::vector< std::vector< std::string > > &	getLabels () const
const std::vector< std::vector< std::string > > &	getLabels () const
void	setAllocator (TensorAllocator cpuAlloc, EventAllocator event)
void	setAllocator (TensorAllocator cpuAlloc, EventAllocator event)
bool	needInputCopy () const
bool	needInputCopy () const
virtual NvDsInferStatus	allocateResource (const std::vector< int > &devIds) override
virtual NvDsInferStatus	allocateResource (const std::vector< int > &devIds) override
NvDsInferStatus	postCudaProcess (SharedBatchArray inBuf, SharedCuStream mainStream, PostprocessDone done) override
	Acquire an output buffer array and call CUDA post processing steps. More...
NvDsInferStatus	postCudaProcess (SharedBatchArray inBuf, SharedCuStream mainStream, PostprocessDone done) override
	Acquire an output buffer array and call CUDA post processing steps. More...
NvDsInferStatus	postHostProcess (SharedBatchArray inBuf, SharedCuStream mainStream, PostprocessDone done) override
	Acquire an output buffer array and call host side processing steps. More...
NvDsInferStatus	postHostProcess (SharedBatchArray inBuf, SharedCuStream mainStream, PostprocessDone done) override
	Acquire an output buffer array and call host side processing steps. More...

Protected Member Functions
NvDsInferStatus	postCudaImpl (SharedBatchArray &inBuf, SharedBatchArray &outbuf, SharedCuStream &mainStream) override
NvDsInferStatus	postCudaImpl (SharedBatchArray &inBuf, SharedBatchArray &outbuf, SharedCuStream &mainStream) override
NvDsInferStatus	postHostImpl (SharedBatchArray &inBuf, SharedBatchArray &outbuf, SharedCuStream &mainStream) override
NvDsInferStatus	postHostImpl (SharedBatchArray &inBuf, SharedBatchArray &outbuf, SharedCuStream &mainStream) override
SharedBatchArray	requestCudaOutBufs (const SharedBatchArray &inBuf) override
SharedBatchArray	requestCudaOutBufs (const SharedBatchArray &inBuf) override
SharedBatchArray	requestHostOutBufs (const SharedBatchArray &inBuf) override
SharedBatchArray	requestHostOutBufs (const SharedBatchArray &inBuf) override
NvDsInferStatus	parseLabelsFile (const std::string &path)
NvDsInferStatus	parseLabelsFile (const std::string &path)

Protected Attributes
SharedDllHandle	m_CustomLibHandle
	Custom library implementation. More...
bool	m_CopyInputToHostBuffers = false
NvDsInferNetworkInfo	m_NetworkInfo = {0}
	Network input information. More...
uint32_t	m_OutputLayerCount = 0
std::string	m_LabelPath
std::vector< std::vector< std::string > >	m_Labels
	Holds the string labels for classes. More...
TensorAllocator	m_CpuAllocator
EventAllocator	m_EventAllocator

Member Typedef Documentation

EventAllocator [1/2]

using nvdsinferserver::Postprocessor::EventAllocator = std::function<SharedCuEvent()>

inherited

Definition at line 62 of file sources/libs/nvdsinferserver/infer_postprocess.h.

EventAllocator [2/2]

using nvdsinferserver::Postprocessor::EventAllocator = std::function<SharedCuEvent()>

inherited

Definition at line 62 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

PostprocessDone [1/2]

using nvdsinferserver::IPostprocessor::PostprocessDone = std::function<void(NvDsInferStatus, SharedBatchArray)>

inherited

Definition at line 67 of file sources/libs/nvdsinferserver/infer_iprocess.h.

PostprocessDone [2/2]

using nvdsinferserver::IPostprocessor::PostprocessDone = std::function<void(NvDsInferStatus, SharedBatchArray)>

inherited

Definition at line 67 of file 9.1/sources/libs/nvdsinferserver/infer_iprocess.h.

TensorAllocator [1/2]

using nvdsinferserver::Postprocessor::TensorAllocator = std::function<SharedSysMem(const std::string& name, size_t bytes)>

inherited

Definition at line 61 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

TensorAllocator [2/2]

using nvdsinferserver::Postprocessor::TensorAllocator = std::function<SharedSysMem(const std::string& name, size_t bytes)>

inherited

Definition at line 61 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Constructor & Destructor Documentation

OtherPostprocessor() [1/2]

nvdsinferserver::OtherPostprocessor::OtherPostprocessor	(	int	uid,
		const ic::OtherNetworkParams &	params
	)

OtherPostprocessor() [2/2]

nvdsinferserver::OtherPostprocessor::OtherPostprocessor	(	int	uid,
		const ic::OtherNetworkParams &	params
	)

Member Function Documentation

allocateResource() [1/2]

virtual NvDsInferStatus nvdsinferserver::Postprocessor::allocateResource ( const std::vector< int > &  devIds )

overridevirtualinherited

Implements nvdsinferserver::BasePostprocessor.

Reimplemented in nvdsinferserver::SegmentPostprocessor, nvdsinferserver::SegmentPostprocessor, nvdsinferserver::ClassifyPostprocessor, nvdsinferserver::ClassifyPostprocessor, nvdsinferserver::DetectPostprocessor, and nvdsinferserver::DetectPostprocessor.

allocateResource() [2/2]

virtual NvDsInferStatus nvdsinferserver::Postprocessor::allocateResource ( const std::vector< int > &  devIds )

overridevirtualinherited

Implements nvdsinferserver::BasePostprocessor.

Reimplemented in nvdsinferserver::SegmentPostprocessor, nvdsinferserver::SegmentPostprocessor, nvdsinferserver::ClassifyPostprocessor, nvdsinferserver::ClassifyPostprocessor, nvdsinferserver::DetectPostprocessor, and nvdsinferserver::DetectPostprocessor.

getLabels() [1/2]

const std::vector<std::vector<std::string> >& nvdsinferserver::Postprocessor::getLabels ( ) const

inlineinherited

Definition at line 79 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_Labels.

getLabels() [2/2]

const std::vector<std::vector<std::string> >& nvdsinferserver::Postprocessor::getLabels ( ) const

inlineinherited

Definition at line 79 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_Labels.

needInputCopy() [1/2]

bool nvdsinferserver::Postprocessor::needInputCopy ( ) const

inlineinherited

Definition at line 87 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CopyInputToHostBuffers.

needInputCopy() [2/2]

bool nvdsinferserver::Postprocessor::needInputCopy ( ) const

inlineinherited

Definition at line 87 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CopyInputToHostBuffers.

networkType() [1/2]

InferPostprocessType nvdsinferserver::BasePostprocessor::networkType ( ) const

inlineinherited

Definition at line 185 of file sources/libs/nvdsinferserver/infer_iprocess.h.

networkType() [2/2]

InferPostprocessType nvdsinferserver::BasePostprocessor::networkType ( ) const

inlineinherited

Definition at line 185 of file 9.1/sources/libs/nvdsinferserver/infer_iprocess.h.

parseLabelsFile() [1/2]

NvDsInferStatus nvdsinferserver::Postprocessor::parseLabelsFile ( const std::string &  path )

protectedinherited

parseLabelsFile() [2/2]

NvDsInferStatus nvdsinferserver::Postprocessor::parseLabelsFile ( const std::string &  path )

protectedinherited

postCudaImpl() [1/2]

NvDsInferStatus nvdsinferserver::Postprocessor::postCudaImpl ( SharedBatchArray &  inBuf, SharedBatchArray &  outbuf, SharedCuStream &  mainStream  )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

postCudaImpl() [2/2]

NvDsInferStatus nvdsinferserver::Postprocessor::postCudaImpl ( SharedBatchArray &  inBuf, SharedBatchArray &  outbuf, SharedCuStream &  mainStream  )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

postCudaProcess() [1/2]

NvDsInferStatus nvdsinferserver::BasePostprocessor::postCudaProcess ( SharedBatchArray  inBuf, SharedCuStream  mainStream, PostprocessDone  done  )

inlineoverridevirtualinherited

Acquire an output buffer array and call CUDA post processing steps.

Parameters

[in]	inBuf	Pointer to the input batch array.
[in]	mainStream	The main CUDA stream to synchronize with.
[in]	done	Callback function to be executed.

Returns

Error status.

Implements nvdsinferserver::IPostprocessor.

Definition at line 195 of file sources/libs/nvdsinferserver/infer_iprocess.h.

postCudaProcess() [2/2]

NvDsInferStatus nvdsinferserver::BasePostprocessor::postCudaProcess ( SharedBatchArray  inBuf, SharedCuStream  mainStream, PostprocessDone  done  )

inlineoverridevirtualinherited

Acquire an output buffer array and call CUDA post processing steps.

Parameters

[in]	inBuf	Pointer to the input batch array.
[in]	mainStream	The main CUDA stream to synchronize with.
[in]	done	Callback function to be executed.

Returns

Error status.

Implements nvdsinferserver::IPostprocessor.

Definition at line 195 of file 9.1/sources/libs/nvdsinferserver/infer_iprocess.h.

postHostImpl() [1/2]

NvDsInferStatus nvdsinferserver::Postprocessor::postHostImpl ( SharedBatchArray &  inBuf, SharedBatchArray &  outbuf, SharedCuStream &  mainStream  )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

postHostImpl() [2/2]

NvDsInferStatus nvdsinferserver::Postprocessor::postHostImpl ( SharedBatchArray &  inBuf, SharedBatchArray &  outbuf, SharedCuStream &  mainStream  )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

postHostProcess() [1/2]

NvDsInferStatus nvdsinferserver::BasePostprocessor::postHostProcess ( SharedBatchArray  inBuf, SharedCuStream  mainStream, PostprocessDone  done  )

inlineoverridevirtualinherited

Acquire an output buffer array and call host side processing steps.

Parameters

[in]	inBuf	Pointer to the input batch array.
[in]	mainStream	The main CUDA stream to synchronize with.
[in]	done	Callback function to be executed.

Returns

Error status.

Implements nvdsinferserver::IPostprocessor.

Definition at line 209 of file sources/libs/nvdsinferserver/infer_iprocess.h.

postHostProcess() [2/2]

NvDsInferStatus nvdsinferserver::BasePostprocessor::postHostProcess ( SharedBatchArray  inBuf, SharedCuStream  mainStream, PostprocessDone  done  )

inlineoverridevirtualinherited

Acquire an output buffer array and call host side processing steps.

Parameters

[in]	inBuf	Pointer to the input batch array.
[in]	mainStream	The main CUDA stream to synchronize with.
[in]	done	Callback function to be executed.

Returns

Error status.

Implements nvdsinferserver::IPostprocessor.

Definition at line 209 of file 9.1/sources/libs/nvdsinferserver/infer_iprocess.h.

requestCudaOutBufs() [1/2]

SharedBatchArray nvdsinferserver::Postprocessor::requestCudaOutBufs ( const SharedBatchArray &  inBuf )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

requestCudaOutBufs() [2/2]

SharedBatchArray nvdsinferserver::Postprocessor::requestCudaOutBufs ( const SharedBatchArray &  inBuf )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

requestHostOutBufs() [1/2]

SharedBatchArray nvdsinferserver::Postprocessor::requestHostOutBufs ( const SharedBatchArray &  inBuf )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

requestHostOutBufs() [2/2]

SharedBatchArray nvdsinferserver::Postprocessor::requestHostOutBufs ( const SharedBatchArray &  inBuf )

overrideprotectedvirtualinherited

Implements nvdsinferserver::BasePostprocessor.

setAllocator() [1/2]

void nvdsinferserver::Postprocessor::setAllocator ( TensorAllocator  cpuAlloc, EventAllocator  event  )

inlineinherited

Definition at line 82 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CpuAllocator, and nvdsinferserver::Postprocessor::m_EventAllocator.

setAllocator() [2/2]

void nvdsinferserver::Postprocessor::setAllocator ( TensorAllocator  cpuAlloc, EventAllocator  event  )

inlineinherited

Definition at line 82 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CpuAllocator, and nvdsinferserver::Postprocessor::m_EventAllocator.

setDllHandle() [1/2]

void nvdsinferserver::Postprocessor::setDllHandle ( const SharedDllHandle &  dlHandle )

inlineinherited

Definition at line 70 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CustomLibHandle.

setDllHandle() [2/2]

void nvdsinferserver::Postprocessor::setDllHandle ( const SharedDllHandle &  dlHandle )

inlineinherited

Definition at line 70 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CustomLibHandle.

setInputCopy() [1/2]

void nvdsinferserver::Postprocessor::setInputCopy ( bool  enable )

inlineinherited

Definition at line 78 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CopyInputToHostBuffers.

setInputCopy() [2/2]

void nvdsinferserver::Postprocessor::setInputCopy ( bool  enable )

inlineinherited

Definition at line 78 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_CopyInputToHostBuffers.

setLabelPath() [1/2]

void nvdsinferserver::Postprocessor::setLabelPath ( const std::string &  path )

inlineinherited

Definition at line 73 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_LabelPath.

setLabelPath() [2/2]

void nvdsinferserver::Postprocessor::setLabelPath ( const std::string &  path )

inlineinherited

Definition at line 73 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_LabelPath.

setNetworkInfo() [1/2]

void nvdsinferserver::Postprocessor::setNetworkInfo ( const NvDsInferNetworkInfo &  info )

inlineinherited

Definition at line 74 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_NetworkInfo.

setNetworkInfo() [2/2]

void nvdsinferserver::Postprocessor::setNetworkInfo ( const NvDsInferNetworkInfo &  info )

inlineinherited

Definition at line 74 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_NetworkInfo.

setOutputLayerCount() [1/2]

void nvdsinferserver::Postprocessor::setOutputLayerCount ( uint32_t  num )

inlineinherited

Definition at line 77 of file sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_OutputLayerCount.

setOutputLayerCount() [2/2]

void nvdsinferserver::Postprocessor::setOutputLayerCount ( uint32_t  num )

inlineinherited

Definition at line 77 of file 9.1/sources/libs/nvdsinferserver/infer_postprocess.h.

References nvdsinferserver::Postprocessor::m_OutputLayerCount.

setUniqueId() [1/2]

void nvdsinferserver::BasePostprocessor::setUniqueId ( int  id )

inlineinherited

Definition at line 183 of file 9.1/sources/libs/nvdsinferserver/infer_iprocess.h.

setUniqueId() [2/2]

void nvdsinferserver::BasePostprocessor::setUniqueId ( int  id )

inlineinherited

Definition at line 183 of file sources/libs/nvdsinferserver/infer_iprocess.h.

uniqueId() [1/2]

int nvdsinferserver::BasePostprocessor::uniqueId ( ) const

inlineinherited

Definition at line 184 of file sources/libs/nvdsinferserver/infer_iprocess.h.

uniqueId() [2/2]

int nvdsinferserver::BasePostprocessor::uniqueId ( ) const

inlineinherited

Definition at line 184 of file 9.1/sources/libs/nvdsinferserver/infer_iprocess.h.

Field Documentation

m_CopyInputToHostBuffers

bool nvdsinferserver::Postprocessor::m_CopyInputToHostBuffers = false

protectedinherited

Definition at line 117 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::needInputCopy(), and nvdsinferserver::Postprocessor::setInputCopy().

m_CpuAllocator

TensorAllocator nvdsinferserver::Postprocessor::m_CpuAllocator

protectedinherited

Definition at line 126 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::setAllocator().

m_CustomLibHandle

SharedDllHandle nvdsinferserver::Postprocessor::m_CustomLibHandle

protectedinherited

Custom library implementation.

Definition at line 116 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::setDllHandle().

m_EventAllocator

EventAllocator nvdsinferserver::Postprocessor::m_EventAllocator

protectedinherited

Definition at line 127 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::setAllocator().

m_LabelPath

std::string nvdsinferserver::Postprocessor::m_LabelPath

protectedinherited

Definition at line 121 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::setLabelPath().

m_Labels

std::vector< std::vector< std::string > > nvdsinferserver::Postprocessor::m_Labels

protectedinherited

Holds the string labels for classes.

Definition at line 124 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::getLabels().

m_NetworkInfo

NvDsInferNetworkInfo nvdsinferserver::Postprocessor::m_NetworkInfo = {0}

protectedinherited

Network input information.

Definition at line 119 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::setNetworkInfo().

m_OutputLayerCount

uint32_t nvdsinferserver::Postprocessor::m_OutputLayerCount = 0

protectedinherited

Definition at line 120 of file sources/libs/nvdsinferserver/infer_postprocess.h.

Referenced by nvdsinferserver::Postprocessor::setOutputLayerCount().

---

The documentation for this class was generated from the following file:

• sources/libs/nvdsinferserver/infer_postprocess.h