Struct InferenceMemoryInterfaceProxy

Base Type

Derived Types

struct InferenceMemoryInterfaceProxy : public morpheus::TensorMemoryInterfaceProxy

Interface proxy, used to insulate python bindings.

Subclassed by morpheus::InferenceMemoryFILInterfaceProxy, morpheus::InferenceMemoryNLPInterfaceProxy

Public Static Functions

static std::shared_ptr<InferenceMemory> init(TensorIndex count, pybind11::object &tensors)

Create and initialize a InferenceMemory object, and return a shared pointer to the result. Each array in tensors should be of length count.

Parameters
  • count – : Lenght of each array in tensors

  • tensors – : Map of string on to cupy arrays

Returns

std::shared_ptr<InferenceMemory>

Previous Struct InferenceMemoryFILInterfaceProxy
Next Struct InferenceMemoryNLPInterfaceProxy
© Copyright 2024, NVIDIA. Last updated on Apr 25, 2024.