Function TRTSERVER_InferenceRequestProviderInputBatchByteSize

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestProviderInputBatchByteSize(TRTSERVER_InferenceRequestProvider *request_provider, const char *name, uint64_t *byte_size)

Get the size, in bytes, expected by the inference server for the named input tensor.

The returned size is the total size for the entire batch of the input.

Return

a TRTSERVER_Error indicating success or failure.

Parameters

  • request_provider: The request provider object.

  • name: The name of the input.

  • byte_size: Returns the size, in bytes, of the full batch of tensors for the named input.