Class InferenceMemory

Base Type

Derived Types

class InferenceMemory : public morpheus::TensorMemory

This is a base container class for data that will be used for inference stages. This class is designed to hold generic data as a TensorObjects.

Subclassed by morpheus::InferenceMemoryFIL, morpheus::InferenceMemoryNLP

Public Functions

InferenceMemory(size_t count)

Construct a new Inference Memory object.

Parameters

count

InferenceMemory(size_t count, tensor_map_t &&tensors)

Construct a new Inference Memory object.

Parameters
  • count

  • tensors

bool has_input(const std::string &name) const

Checks if a tensor named name exists in tensors

Parameters

name

Returns

true

Returns

false

© Copyright 2023, NVIDIA. Last updated on Feb 3, 2023.