Function TRTSERVER_InferenceRequestOptionsSetBatchSize

• Defined in File trtserver.h

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestOptionsSetBatchSize(TRTSERVER_InferenceRequestOptions *request_options, uint32_t batch_size)

Set the batch size for the request in a request options.

Return

a TRTSERVER_Error indicating success or failure.

Parameters

• request_options: The request options object.

• batch_size: The batch size.