Function TRITONSERVER_InferenceRequestSetPriority

• Defined in File tritonserver.h

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestSetPriority(TRITONSERVER_InferenceRequest *inference_request, uint32_t priority)

Set the priority for a request.

The default is 0 indicating that the request does not specify a priority and so will use the model’s default priority.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

• inference_request: The request object.

• priority: The priority level.