morpheus.messages.memory.inference_memory

Classes

`InferenceMemory`(*[, count, tensors])	This is a base container class for data that will be used for inference stages.
`InferenceMemoryAE`(*, count, input, seq_ids)	This is a container class for data that needs to be submitted to the inference server for auto encoder usecases.
`InferenceMemoryFIL`(*, count, input__0, seq_ids)	This is a container class for data that needs to be submitted to the inference server for FIL category usecases.
`InferenceMemoryNLP`(*, count, input_ids, ...)	This is a container class for data that needs to be submitted to the inference server for NLP category usecases.