NVIDIA Agent Intelligence Toolkit Memory Module#

The AIQ toolkit Memory subsystem is designed to store and retrieve a user’s conversation history, preferences, and other “long-term memory.” This is especially useful for building stateful LLM-based applications that recall user-specific data or interactions across multiple steps.

The memory module is designed to be extensible, allowing developers to create custom memory back-ends, providers in AIQ toolkit terminology.

Included Memory Modules#

The AIQ toolkit includes two memory module providers, both of which are available as plugins:

Examples#

The following examples demonstrate how to use the memory module in the AIQ toolkit:

  • examples/simple_rag

  • examples/semantic_kernel_demo

Additional Resources#

For information on how to write a new memory module provider can be found in the Adding a Memory Provider document.