nvdsinferserver::TrtServerAllocator Class Reference
Detailed Description
Wrapper class for Triton server output memory allocator.
Definition at line 351 of file infer_trtis_server.h.
Inheritance diagram for nvdsinferserver::TrtServerAllocator:
Collaboration diagram for nvdsinferserver::TrtServerAllocator:
Public Types | |
| using | AllocFn = std::function< SharedSysMem(const std::string &, size_t, InferMemType, int64_t)> |
| using | FreeFn = std::function< void(const std::string &, SharedSysMem)> |
Public Member Functions | |
| TrtServerAllocator (AllocFn alloc, FreeFn release) | |
| Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions. More... | |
| virtual | ~TrtServerAllocator ()=default |
| Destructor. More... | |
| TRITONSERVER_ResponseAllocator * | ptr () |
| Get the pointer to the TRITONSERVER_ResponseAllocator instance. More... | |
Member Typedef Documentation
◆ AllocFn
| using nvdsinferserver::TrtServerAllocator::AllocFn = std::function<SharedSysMem(const std::string&, size_t, InferMemType, int64_t)> |
Definition at line 354 of file infer_trtis_server.h.
◆ FreeFn
| using nvdsinferserver::TrtServerAllocator::FreeFn = std::function<void(const std::string&, SharedSysMem)> |
Definition at line 355 of file infer_trtis_server.h.
Constructor & Destructor Documentation
◆ TrtServerAllocator()
Constructor, create an instance of the type TRITONSERVER_ResponseAllocator which calls provided allocator and release functions.
- Parameters
-
alloc Allocation function for the output tensors. release Release function for the output tensors.
◆ ~TrtServerAllocator()
|
virtualdefault |
Destructor.
Default.
Member Function Documentation
◆ ptr()
|
inline |
Get the pointer to the TRITONSERVER_ResponseAllocator instance.
Definition at line 374 of file infer_trtis_server.h.
The documentation for this class was generated from the following file: