Struct custom_initdata_struct

• Defined in File custom.h

Struct Documentation

struct custom_initdata_struct

Public Members

const char *instance_name

The name of this instance of the custom backend.

Instance names are unique.

const char *serialized_model_config

Serialized representation of the model configuration.

This serialization is owned by the caller and must be copied if a persistent copy of required by the custom backend.

size_t serialized_model_config_size

The size of ‘serialized_model_config’, in bytes.

int gpu_device_id

The GPU device ID to initialize for, or CUSTOM_NO_GPU_DEVICE if should initialize for CPU.

size_t server_parameter_cnt

The number of server parameters (i.e.

the length of ‘server_parameters’).

const char **server_parameters

The server parameter values as null-terminated strings, indexed by CustomServerParameter.

This strings are owned by the caller and must be copied if a persistent copy of required by the custom backend.