NVIDIA NeMo Agent Toolkit Memory Module

The NeMo Agent toolkit Memory subsystem is designed to store and retrieve a user’s conversation history, preferences, and other “long-term memory.” This is especially useful for building stateful LLM-based applications that recall user-specific data or interactions across multiple steps.

The memory module is designed to be extensible, allowing developers to create custom memory back-ends, providers in NeMo Agent toolkit terminology.

Included Memory Modules

The NeMo Agent toolkit includes three memory module providers, all of which are available as plugins:

• Mem0 which is provided by the nvidia-nat-mem0ai plugin.

• Redis which is provided by the nvidia-nat-redis plugin.

• Zep which is provided by the nvidia-nat-zep-cloud plugin.

Examples

The following examples demonstrate how to use the memory module in the NeMo Agent toolkit:

• examples/memory/redis

• examples/frameworks/semantic_kernel_demo

• examples/RAG/simple_rag

Additional Resources

For information on how to write a new memory module provider can be found in the Adding a Memory Provider document.