Function TRTSERVER_InferenceRequestProviderSetInputData¶
Defined in File trtserver.h
Function Documentation¶
-
TRTSERVER_Error *
TRTSERVER_InferenceRequestProviderSetInputData
(TRTSERVER_InferenceRequestProvider *request_provider, const char *name, const void *base, size_t byte_size, TRTSERVER_Memory_Type memory_type, int64_t memory_type_id)¶ Assign a buffer of data to an input.
The buffer will be appended to any existing buffers for that input. The ‘request_provider’ takes ownership of the buffer and so the caller should not modify or free the buffer until that ownership is released when ‘request_provider’ is deleted. The total size of data that is provided for an input must equal the value returned by TRTSERVER_InferenceRequestProviderInputBatchByteSize().
- Return
a TRTSERVER_Error indicating success or failure.
- Parameters
request_provider
: The request provider object.name
: The name of the input.base
: The base address of the input data.byte_size
: The size, in bytes, of the input data.memory_type
: The memory type of the input data.memory_type_id
: The memory type id of the input data.