Struct InferenceMemoryInterfaceProxy

(Latest Version)

Base Type

Derived Types

struct InferenceMemoryInterfaceProxy : public morpheus::TensorMemoryInterfaceProxy

Interface proxy, used to insulate python bindings.

Subclassed by morpheus::InferenceMemoryFILInterfaceProxy, morpheus::InferenceMemoryNLPInterfaceProxy

Public Static Functions

static std::shared_ptr<InferenceMemory> init(TensorIndex count, pybind11::object &tensors)

Create and initialize a InferenceMemory object, and return a shared pointer to the result. Each array in tensors should be of length count.

  • count – : Lenght of each array in tensors

  • tensors – : Map of string on to cupy arrays



© Copyright 2023, NVIDIA. Last updated on Apr 11, 2023.