Function TRTSERVER_InferenceRequestOptionsSetCorrelationId

• Defined in File trtserver.h

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestOptionsSetCorrelationId(TRTSERVER_InferenceRequestOptions *request_options, uint64_t correlation_id)

The correlation ID of the inference request.

Default is 0, which indictes that the request has no correlation ID. The correlation ID is used to indicate two or more inference request are related to each other. How this relationship is handled by the inference server is determined by the model’s scheduling policy.

Return

a TRTSERVER_Error indicating success or failure.

Parameters

• request_options: The request options object.

• correlation_id: The correlation ID.