Typedef TRITONSERVER_ResponseAllocatorStartFn_t

Typedef Documentation

typedef TRITONSERVER_Error *(*TRITONSERVER_ResponseAllocatorStartFn_t)(TRITONSERVER_ResponseAllocator *allocator, void *userp)

Type for function that is called to indicate that subsequent allocation requests will refer to a new response.

Return

a TRITONSERVER_Error object if a failure occurs.

Parameters
  • allocator: The allocator that is provided in the call to TRITONSERVER_InferenceRequestSetResponseCallback.

  • userp: The user data pointer that is provided as ‘response_allocator_userp’ in the call to TRITONSERVER_InferenceRequestSetResponseCallback.