Struct custom_payload_struct

Struct Documentation

struct custom_payload_struct

A payload represents the input tensors and the required output needed for execution in the backend.

Public Members

uint32_t batch_size

The size of the batch represented by this payload.

uint32_t input_cnt

The number of inputs included in this payload.

const char **input_names

For each of the ‘input_cnt’ inputs, the name of the input as a null-terminated string.

const size_t *input_shape_dim_cnts

For each of the ‘input_cnt’ inputs, the number of dimensions in the input’s shape, not including the batch dimension.

const int64_t **input_shape_dims

For each of the ‘input_cnt’ inputs, the shape of the input, not including the batch dimension.

uint32_t output_cnt

The number of outputs that must be computed for this payload.

Can be 0 to indicate that no outputs are required from the backend.

const char **required_output_names

For each of the ‘output_cnt’ outputs, the name of the output as a null-terminated string.

Each name must be one of the names from the model configuration, but all outputs do not need to be computed.

void *input_context

The context to use with CustomGetNextInput callback function to get the input tensor values for this payload.

void *output_context

The context to use with CustomGetOutput callback function to get the buffer for output tensor values for this payload.

int error_code

The error code indicating success or failure from execution.

A value of 0 (zero) indicates success, all other values indicate failure and are backend defined.