Typedef TRITONSERVER_InferenceRequestReleaseFn_t

Typedef Documentation

typedef void (*TRITONSERVER_InferenceRequestReleaseFn_t)(TRITONSERVER_InferenceRequest *request, void *userp)

Type for inference request release callback function.

The callback function takes ownership of the TRITONSERVER_InferenceRequest object. The ‘userp’ data is the same as what is supplied in the call to TRITONSERVER_ServerInferAsync.