Struct TritonInferInput

(Latest Version)
struct TritonInferInput

Public Members

std::string name

The name of the triton inference input.

std::vector<int64_t> shape

The shape of the triton inference input.

std::string type

The type of the triton inference input.

std::vector<uint8_t> data

The triton inference input data.

Previous Struct TensorUtils
Next Struct TritonInferRequestedOutput
© Copyright 2024, NVIDIA. Last updated on Jul 8, 2024.