Function TRTSERVER_InferenceRequestProviderNewV2¶
Defined in File trtserver.h
Function Documentation¶
-
TRTSERVER_Error *
TRTSERVER_InferenceRequestProviderNewV2
(TRTSERVER_InferenceRequestProvider **request_provider, TRTSERVER_Server *server, TRTSERVER_InferenceRequestOptions *request_options)¶ Create a new inference request provider object.
The caller retains ownership of ‘request_options’ and the caller must extend the options object’s lifetime to be longer than the lifetime of any providers created with the options object.
- Return
a TRTSERVER_Error indicating success or failure.
- Parameters
request_provider
: Returns the new request provider object.server
: the inference server object.request_options
: The request options object for this inference request.