Function TRTSERVER_InferenceRequestOptionsAddInput

Function Documentation

TRTSERVER_Error *TRTSERVER_InferenceRequestOptionsAddInput(TRTSERVER_InferenceRequestOptions *request_options, const char *input_name, const int64_t *dims, uint64_t dim_count, uint64_t batch_byte_size)

Add a input meta-data associated with the request in a request options.

Return

a TRTSERVER_Error indicating success or failure.

Parameters

  • request_options: The request options object.

  • input_name: The name of the input.

  • dims: The shape of the input. nullptr can be used if the input shape is fixed size.

  • dim_count: The length ‘dims’.

  • batch_byte_size: The size of the full batch of the input tensor, in bytes. This field is only requried for non-fixed-size data type (like STRING). In the case of fixed-size data type, 0 can always be set for this field.