Struct InferenceMemoryInterfaceProxy

• Defined in File inference_memory.hpp

Base Type

• public morpheus::TensorMemoryInterfaceProxy (Struct TensorMemoryInterfaceProxy)

Derived Types

• public morpheus::InferenceMemoryFILInterfaceProxy (Struct InferenceMemoryFILInterfaceProxy)

• public morpheus::InferenceMemoryNLPInterfaceProxy (Struct InferenceMemoryNLPInterfaceProxy)

struct InferenceMemoryInterfaceProxy : public morpheus::TensorMemoryInterfaceProxy

Interface proxy, used to insulate python bindings.

Subclassed by morpheus::InferenceMemoryFILInterfaceProxy, morpheus::InferenceMemoryNLPInterfaceProxy

Public Static Functions

static std::shared_ptr<InferenceMemory> init(TensorIndex count, pybind11::object &tensors)

Create and initialize a InferenceMemory object, and return a shared pointer to the result. Each array in tensors should be of length count.

Parameters

• count – : Lenght of each array in tensors

• tensors – : Map of string on to cupy arrays

Returns

std::shared_ptr<InferenceMemory>