Function TRITONSERVER_InferenceRequestSetCorrelationId

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestSetCorrelationId(TRITONSERVER_InferenceRequest *inference_request, uint64_t correlation_id)

Set the correlation ID of the inference request.

Default is 0, which indictes that the request has no correlation ID. The correlation ID is used to indicate two or more inference request are related to each other. How this relationship is handled by the inference server is determined by the model’s scheduling policy.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • inference_request: The request object.

  • correlation_id: The correlation ID.