Function TRITONSERVER_InferenceRequestSetTimeoutMicroseconds

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestSetTimeoutMicroseconds(TRITONSERVER_InferenceRequest *inference_request, uint64_t timeout_us)

Set the timeout for a request, in microseconds.

The default is 0 which indicates that the request has no timeout.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters
  • inference_request: The request object.

  • timeout_us: The timeout, in microseconds.