Function TRTSERVER_ResponseAllocatorNew¶
Defined in File trtserver.h
Function Documentation¶
-
TRTSERVER_Error *
TRTSERVER_ResponseAllocatorNew
(TRTSERVER_ResponseAllocator **allocator, TRTSERVER_ResponseAllocatorAllocFn_t alloc_fn, TRTSERVER_ResponseAllocatorReleaseFn_t release_fn)¶ Create a new response allocator object.
- Return
a TRTSERVER_Error indicating success or failure.
- Parameters
allocator
: Returns the new response allocator object.alloc_fn
: The function to call to allocate buffers for result tensors.release_fn
: The function to call when the server no longer holds a reference to an allocated buffer.