Function TRTSERVER_InferenceRequestProviderInputBatchByteSize¶
Defined in File trtserver.h
Function Documentation¶
-
TRTSERVER_Error *
TRTSERVER_InferenceRequestProviderInputBatchByteSize
(TRTSERVER_InferenceRequestProvider *request_provider, const char *name, uint64_t *byte_size)¶ Get the size, in bytes, expected by the inference server for the named input tensor.
The returned size is the total size for the entire batch of the input.
- Return
a TRTSERVER_Error indicating success or failure.
- Parameters
request_provider
: The request provider object.name
: The name of the input.byte_size
: Returns the size, in bytes, of the full batch of tensors for the named input.