Typedef TRTSERVER_InferenceCompleteFn_t¶
Defined in File trtserver.h
Typedef Documentation¶
-
typedef void (*
TRTSERVER_InferenceCompleteFn_t
)(TRTSERVER_Server *server, TRTSERVER_Trace *trace, TRTSERVER_InferenceResponse *response, void *userp)¶ Type for inference completion callback function.
If non-nullptr, the ‘trace’ object is the trace associated with the request that is completing. The callback function takes ownership of the TRTSERVER_Trace object and must call TRTSERVER_TraceDelete to release the object. The callback function takes ownership of the TRTSERVER_InferenceResponse object and must call TRTSERVER_InferenceResponseDelete to release the object. The ‘userp’ data is the same as what is supplied in the call to TRTSERVER_ServerInferAsync.