Struct TritonInferInput#

Struct Documentation#

struct TritonInferInput#

Public Members

std::string name#

The name of the triton inference input.

std::vector<int64_t> shape#

The shape of the triton inference input.

std::string type#

The type of the triton inference input.

std::vector<uint8_t> data#

The triton inference input data.