Function TRITONSERVER_InferenceRequestTimeoutMicroseconds

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestTimeoutMicroseconds(TRITONSERVER_InferenceRequest *inference_request, uint64_t *timeout_us)

Get the timeout for a request, in microseconds.

The default is 0 which indicates that the request has no timeout.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters
  • inference_request: The request object.

  • timeout_us: Returns the timeout, in microseconds.