Struct NetworkOptions

Parameters for Engine creation.

Public Members

bool use_fp16 = true

Use FP16 in engine generation.

std::vector<int32_t> batch_sizes = {1}

Batch sizes supported.

int32_t max_batch_size = 1

Max batch size allowed.

size_t max_memory = 10000000000

Maximum GPU memory allocated for model conversion.

int device_index = 0

GPU device.