Defined in File trtserver.h
typedef void (*
TRTSERVER_InferenceCompleteFn_t)(TRTSERVER_Server *server, TRTSERVER_TraceManager *trace_manager, TRTSERVER_InferenceResponse *response, void *userp)¶
Type for inference completion callback function.
If non-nullptr, the ‘trace_manager’ object is the trace manager associated with the request that is completing. The callback function takes ownership of the TRTSERVER_TraceManager object and must call TRTSERVER_TraceManagerDelete to release the object. The callback function takes ownership of the TRTSERVER_InferenceResponse object and must call TRTSERVER_InferenceResponseDelete to release the object. The ‘userp’ data is the same as what is supplied in the call to TRTSERVER_ServerInferAsync.