morpheus.messages.tensor_memory.TensorMemory
- class TensorMemory(*args, **kwargs)[source]
Bases:
<a href="morpheus.messages.message_base.MessageData.html#morpheus.messages.message_base.MessageData">morpheus.messages.message_base.MessageData</a>
This is a base container class for data that will be used for inference stages. This class is designed to hold generic tensor data in cupy arrays.
- Parameters
- countint
Number of inference inputs.
- inputstyping.Dict[str, cupy.ndarray]
Inference inputs to model.