Function TRITONSERVER_InferenceRequestCorrelationId

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestCorrelationId(TRITONSERVER_InferenceRequest *inference_request, uint64_t *correlation_id)

Get the correlation ID of the inference request.

Default is 0, which indictes that the request has no correlation ID. The correlation ID is used to indicate two or more inference request are related to each other. How this relationship is handled by the inference server is determined by the model’s scheduling policy.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • inference_request: The request object.

  • correlation_id: Returns the correlation ID.