Struct TensorMemoryInterfaceProxy
Defined in File tensor_memory.hpp
Derived Types
public morpheus::InferenceMemoryInterfaceProxy
(Struct InferenceMemoryInterfaceProxy)public morpheus::ResponseMemoryInterfaceProxy
(Struct ResponseMemoryInterfaceProxy)
-
struct TensorMemoryInterfaceProxy
Interface proxy, used to insulate python bindings.
Subclassed by morpheus::InferenceMemoryInterfaceProxy, morpheus::ResponseMemoryInterfaceProxy
Public Static Functions
-
static std::shared_ptr<TensorMemory> init(TensorIndex count, pybind11::object &tensors)
Create and initialize a TensorMemory object, and return a shared pointer to the result. Each array in
tensors
should be of lengthcount
.- Parameters
count – : Lenght of each array in
tensors
tensors – : Map of string on to cupy arrays
- Returns
std::shared_ptr<TensorMemory>
-
static TensorIndex get_count(TensorMemory &self)
Get the count object.
- Parameters
self –
- Returns
TensorIndex
-
static std::vector<std::string> tensor_names_getter(TensorMemory &self)
Returns a list of the current tensor names.
- Parameters
self –
- Returns
std::vector<std::string>
-
static bool has_tensor(TensorMemory &self, std::string name)
Returns true if a tensor with the requested name exists in the tensors object.
- Parameters
name – Tensor name to lookup
-
static CupyUtil::py_tensor_map_t get_tensors(TensorMemory &self)
Get the tensors converted to CuPy arrays. Pybind11 will convert the std::map to a Python dict.
- Parameters
self –
- Returns
py_tensor_map_t
-
static void set_tensors(TensorMemory &self, CupyUtil::py_tensor_map_t tensors)
Set the tensors object converting a map of CuPy arrays to Tensors.
- Parameters
self –
tensors –
-
static pybind11::object get_tensor(TensorMemory &self, const std::string name)
Get the tensor object identified by
name
- Parameters
self –
name –
- Throws
pybind11::key_error – When no matching tensor exists.
- Returns
pybind11::object
-
static pybind11::object get_tensor_property(TensorMemory &self, const std::string name)
Same as
get_tensor
but used when the method is being bound to a python property.- Parameters
self –
name –
- Throws
pybind11::attribute_error – When no matching tensor exists.
- Returns
pybind11::object
-
static void set_tensor(TensorMemory &self, const std::string name, const pybind11::object &cupy_tensor)
Set the tensor object identified by
name
- Parameters
self –
cupy_tensor –
-
static std::shared_ptr<TensorMemory> init(TensorIndex count, pybind11::object &tensors)