Function TRITONSERVER_InferenceRequestPriority

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestPriority(TRITONSERVER_InferenceRequest *inference_request, uint32_t *priority)

Get the priority for a request.

The default is 0 indicating that the request does not specify a priority and so will use the model’s default priority.


a TRITONSERVER_Error indicating success or failure.

  • inference_request: The request object.

  • priority: Returns the priority level.