Function TRTSERVER_ResponseAllocatorNew

• Defined in File trtserver.h

Function Documentation

TRTSERVER_Error *TRTSERVER_ResponseAllocatorNew(TRTSERVER_ResponseAllocator **allocator, TRTSERVER_ResponseAllocatorAllocFn_t alloc_fn, TRTSERVER_ResponseAllocatorReleaseFn_t release_fn)

Create a new response allocator object.

Return

a TRTSERVER_Error indicating success or failure.

Parameters

• allocator: Returns the new response allocator object.

• alloc_fn: The function to call to allocate buffers for result tensors.

• release_fn: The function to call when the server no longer holds a reference to an allocated buffer.