Function TRTSERVER_InferenceRequestOptionsSetBatchSize¶
Defined in File trtserver.h
Function Documentation¶
-
TRTSERVER_Error *
TRTSERVER_InferenceRequestOptionsSetBatchSize
(TRTSERVER_InferenceRequestOptions *request_options, uint32_t batch_size)¶ Set the batch size for the request in a request options.
- Return
a TRTSERVER_Error indicating success or failure.
- Parameters
request_options
: The request options object.batch_size
: The batch size.