morpheus.messages.memory.inference_memory

(Latest Version)

Classes

InferenceMemory(*[, count, tensors])

This is a base container class for data that will be used for inference stages.

InferenceMemoryAE(*, count, input, seq_ids)

This is a container class for data that needs to be submitted to the inference server for auto encoder usecases.

InferenceMemoryFIL(*, count, input__0, seq_ids)

This is a container class for data that needs to be submitted to the inference server for FIL category usecases.

InferenceMemoryNLP(*, count, input_ids, ...)

This is a container class for data that needs to be submitted to the inference server for NLP category usecases.

© Copyright 2023, NVIDIA. Last updated on Apr 11, 2023.