Wrapper class for Triton server output memory allocator.
Definition at line 351 of file infer_trtis_server.h.
Public Types | |
using | AllocFn = std::function< SharedSysMem(const std::string &, size_t, InferMemType, int64_t)> |
using | FreeFn = std::function< void(const std::string &, SharedSysMem)> |
Public Member Functions | |
TrtServerAllocator (AllocFn alloc, FreeFn release) | |
Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions. More... | |
virtual | ~TrtServerAllocator ()=default |
Destructor. More... | |
TRITONSERVER_ResponseAllocator * | ptr () |
Get the pointer to the TRITONSERVER_ResponseAllocator instance. More... | |
using nvdsinferserver::TrtServerAllocator::AllocFn = std::function<SharedSysMem(const std::string&, size_t, InferMemType, int64_t)> |
Definition at line 354 of file infer_trtis_server.h.
using nvdsinferserver::TrtServerAllocator::FreeFn = std::function<void(const std::string&, SharedSysMem)> |
Definition at line 355 of file infer_trtis_server.h.
Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions.
alloc | Allocation function for the output tensors. |
release | Release function for the output tensors. |
|
virtualdefault |
Destructor.
Default.
|
inline |
Get the pointer to the TRITONSERVER_ResponseAllocator instance.
Definition at line 374 of file infer_trtis_server.h.