Defined in File trtserver.h
typedef void (*
TRTSERVER_InferenceCompleteFn_t)(TRTSERVER_Server *server, TRTSERVER_Trace *trace, TRTSERVER_InferenceResponse *response, void *userp)¶
Type for inference completion callback function.
If non-nullptr, the ‘trace’ object is the trace associated with the request that is completing. The callback function takes ownership of the TRTSERVER_Trace object and must call TRTSERVER_TraceDelete to release the object. The callback function takes ownership of the TRTSERVER_InferenceResponse object and must call TRTSERVER_InferenceResponseDelete to release the object. The ‘userp’ data is the same as what is supplied in the call to TRTSERVER_ServerInferAsync.