Function TRTSERVER_InferenceRequestOptionsNew

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestOptionsNew(TRTSERVER_InferenceRequestOptions **request_options, const char *model_name, int64_t model_version)

Create a new inference request options object.

Return

a TRTSERVER_Error indicating success or failure.

Parameters
  • request_options: Returns the new request options object.

  • model_name: The name of the model that the inference request is for.

  • model_version: The version of the model that the inference request is for, or -1 to select the latest (highest numbered) version.