(Latest Version)

morpheus.messages.memory.inference_memory

Classes

<a href="morpheus.messages.memory.inference_memory.InferenceMemory.html#morpheus.messages.memory.inference_memory.InferenceMemory">InferenceMemory</a>(*[, count, tensors])

This is a base container class for data that will be used for inference stages.

<a href="morpheus.messages.memory.inference_memory.InferenceMemoryAE.html#morpheus.messages.memory.inference_memory.InferenceMemoryAE">InferenceMemoryAE</a>(*, count, input, seq_ids)

This is a container class for data that needs to be submitted to the inference server for auto encoder usecases.

<a href="morpheus.messages.html#morpheus.messages.InferenceMemoryFIL">InferenceMemoryFIL</a>(*, count, input__0, seq_ids)

This is a container class for data that needs to be submitted to the inference server for FIL category usecases.

<a href="morpheus.messages.html#morpheus.messages.InferenceMemoryNLP">InferenceMemoryNLP</a>(*, count, input_ids, ...)

This is a container class for data that needs to be submitted to the inference server for NLP category usecases.

© Copyright 2023, NVIDIA. Last updated on Apr 11, 2023.