Function TRITONSERVER_InferenceRequestSetReleaseCallback

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestSetReleaseCallback(TRITONSERVER_InferenceRequest *inference_request, TRITONSERVER_InferenceRequestReleaseFn_t request_release_fn, void *request_release_userp)

Set the release callback for an inference request.

The release callback is called by Triton to return ownership of the request object.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • inference_request: The request object.

  • request_release_fn: The function called to return ownership of the ‘inference_request’ object.

  • request_release_userp: User-provided pointer that is delivered to the ‘request_release_fn’ callback.