Struct InferenceMemoryInterfaceProxy

(Latest Version)

Base Type

Derived Types

struct InferenceMemoryInterfaceProxy : public morpheus::TensorMemoryInterfaceProxy

Interface proxy, used to insulate python bindings.

Subclassed by morpheus::InferenceMemoryFILInterfaceProxy, morpheus::InferenceMemoryNLPInterfaceProxy

Public Static Functions

static std::shared_ptr<InferenceMemory> init(TensorIndex count, pybind11::object &tensors)

Create and initialize a InferenceMemory object, and return a shared pointer to the result. Each array in tensors should be of length count.

Parameters
  • count – : Lenght of each array in tensors

  • tensors – : Map of string on to cupy arrays

Returns

std::shared_ptr<InferenceMemory>

© Copyright 2023, NVIDIA. Last updated on Apr 11, 2023.