morpheus.messages.multi_inference_message.InferenceMemory

(Latest Version)
class InferenceMemory(*args, **kwargs)[source]

Bases: morpheus.messages.tensor_memory.TensorMemory

This is a base container class for data that will be used for inference stages. This class is designed to hold generic tensor data in cupy arrays.

© Copyright 2023, NVIDIA. Last updated on Feb 3, 2023.