Function TRTSERVER_InferenceRequestProviderNewV2

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestProviderNewV2(TRTSERVER_InferenceRequestProvider **request_provider, TRTSERVER_Server *server, TRTSERVER_InferenceRequestOptions *request_options)

Create a new inference request provider object.

The caller retains ownership of ‘request_options’ and the caller must extend the options object’s lifetime to be longer than the lifetime of any providers created with the options object.

Return

a TRTSERVER_Error indicating success or failure.

Parameters

  • request_provider: Returns the new request provider object.

  • server: the inference server object.

  • request_options: The request options object for this inference request.