Function TRITONSERVER_InferenceRequestAppendInputData

Function Documentation

TRITONSERVER_Error *TRITONSERVER_InferenceRequestAppendInputData(TRITONSERVER_InferenceRequest *inference_request, const char *name, const void *base, size_t byte_size, TRITONSERVER_MemoryType memory_type, int64_t memory_type_id)

Assign a buffer of data to an input.

The buffer will be appended to any existing buffers for that input. The ‘inference_request’ object takes ownership of the buffer and so the caller should not modify or free the buffer until that ownership is released by ‘inference_request’ being deleted or by the input being removed from ‘inference_request’.

Return

a TRITONSERVER_Error indicating success or failure.

Parameters

  • inference_request: The request object.

  • name: The name of the input.

  • base: The base address of the input data.

  • byte_size: The size, in bytes, of the input data.

  • memory_type: The memory type of the input data.

  • memory_type_id: The memory type id of the input data.