Function TRITONSERVER_InferenceRequestPriority¶
Defined in File tritonserver.h
Function Documentation¶
-
TRITONSERVER_Error *
TRITONSERVER_InferenceRequestPriority
(TRITONSERVER_InferenceRequest *inference_request, uint32_t *priority)¶ Get the priority for a request.
The default is 0 indicating that the request does not specify a priority and so will use the model’s default priority.
- Return
a TRITONSERVER_Error indicating success or failure.
- Parameters
inference_request
: The request object.priority
: Returns the priority level.