Struct TritonInferInput

struct TritonInferInput

Public Members

std::string name

The name of the triton inference input.

std::vector<int64_t> shape

The shape of the triton inference input.

std::string type

The type of the triton inference input.

std::vector<uint8_t> data

The triton inference input data.

Previous Struct TensorUtils
Next Struct TritonInferRequestedOutput
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.