Function TRTSERVER_InferenceRequestOptionsSetTimeoutMicroseconds

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestOptionsSetTimeoutMicroseconds(TRTSERVER_InferenceRequestOptions *request_options, uint64_t timeout_us)

Set the timeout for the request in a request options, in microseconds.

Return

a TRTSERVER_Error indicating success or failure.

Parameters
  • request_options: The request options object.

  • timeout_us: The timeout, in microseconds.