Typedef TRTSERVER_InferenceCompleteFn_t

Typedef Documentation

typedef void (*TRTSERVER_InferenceCompleteFn_t)(TRTSERVER_Server *server, TRTSERVER_TraceManager *trace_manager, TRTSERVER_InferenceResponse *response, void *userp)

Type for inference completion callback function.

If non-nullptr, the ‘trace_manager’ object is the trace manager associated with the request that is completing. The callback function takes ownership of the TRTSERVER_TraceManager object and must call TRTSERVER_TraceManagerDelete to release the object. The callback function takes ownership of the TRTSERVER_InferenceResponse object and must call TRTSERVER_InferenceResponseDelete to release the object. The ‘userp’ data is the same as what is supplied in the call to TRTSERVER_ServerInferAsync.