Detailed Description

Wrapper class for Triton server output memory allocator.

Definition at line 351 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

Inheritance diagram for nvdsinferserver::TrtServerAllocator:

Collaboration diagram for nvdsinferserver::TrtServerAllocator:

Public Types
using	AllocFn = std::function< SharedSysMem(const std::string &, size_t, InferMemType, int64_t)>

using	FreeFn = std::function< void(const std::string &, SharedSysMem)>

using	AllocFn = std::function< SharedSysMem(const std::string &, size_t, InferMemType, int64_t)>

using	FreeFn = std::function< void(const std::string &, SharedSysMem)>

Public Member Functions
	TrtServerAllocator (AllocFn alloc, FreeFn release)
	Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions. More...

virtual	~TrtServerAllocator ()=default
	Destructor. More...

TRITONSERVER_ResponseAllocator *	ptr ()
	Get the pointer to the TRITONSERVER_ResponseAllocator instance. More...

	TrtServerAllocator (AllocFn alloc, FreeFn release)
	Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions. More...

virtual	~TrtServerAllocator ()=default
	Destructor. More...

TRITONSERVER_ResponseAllocator *	ptr ()
	Get the pointer to the TRITONSERVER_ResponseAllocator instance. More...

Member Typedef Documentation

◆ AllocFn [1/2]

using nvdsinferserver::TrtServerAllocator::AllocFn = std::function<SharedSysMem(const std::string&, size_t, InferMemType, int64_t)>

Definition at line 354 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

◆ AllocFn [2/2]

using nvdsinferserver::TrtServerAllocator::AllocFn = std::function<SharedSysMem(const std::string&, size_t, InferMemType, int64_t)>

Definition at line 354 of file 9.0/sources/libs/nvdsinferserver/infer_trtis_server.h.

◆ FreeFn [1/2]

using nvdsinferserver::TrtServerAllocator::FreeFn = std::function<void(const std::string&, SharedSysMem)>

Definition at line 355 of file 9.0/sources/libs/nvdsinferserver/infer_trtis_server.h.

◆ FreeFn [2/2]

using nvdsinferserver::TrtServerAllocator::FreeFn = std::function<void(const std::string&, SharedSysMem)>

Definition at line 355 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

Constructor & Destructor Documentation

◆ TrtServerAllocator() [1/2]

nvdsinferserver::TrtServerAllocator::TrtServerAllocator	(	AllocFn	alloc,
		FreeFn	release
	)

Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions.

Parameters

alloc	Allocation function for the output tensors.
release	Release function for the output tensors.

◆ ~TrtServerAllocator() [1/2]

virtual nvdsinferserver::TrtServerAllocator::~TrtServerAllocator ( )

virtualdefault

Destructor.

Default.

◆ TrtServerAllocator() [2/2]

nvdsinferserver::TrtServerAllocator::TrtServerAllocator	(	AllocFn	alloc,
		FreeFn	release
	)

Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions.

Parameters

alloc	Allocation function for the output tensors.
release	Release function for the output tensors.

◆ ~TrtServerAllocator() [2/2]

virtual nvdsinferserver::TrtServerAllocator::~TrtServerAllocator ( )

virtualdefault

Destructor.

Default.

Member Function Documentation

◆ ptr() [1/2]

TRITONSERVER_ResponseAllocator* nvdsinferserver::TrtServerAllocator::ptr ( )

inline

Get the pointer to the TRITONSERVER_ResponseAllocator instance.

Definition at line 374 of file sources/libs/nvdsinferserver/infer_trtis_server.h.

◆ ptr() [2/2]