Support Information for NVIDIA NeMo Evaluator

This documentation describes the software and hardware that NVIDIA NeMo Evaluator supports.

Software Support

You need the following software to use NeMo Evaluator:

• Linux operating systems (Ubuntu 20.04 or later recommended)

• Docker >= 23.0.1

• Kubernetes Version >= v1.26.0

Hardware Support

The software used in an evaluation are the following:

• Nemo Evaluator Microservice

  • Evaluator container (assigned to the pod)

  • Evaluator dependencies

    • Argo Workflows

    • PostgreSQL

    • Milvus

  • Evaluation jobs

• Nemo Microservice Dependencies

  • NeMo Data Store

• NIM Models

  • NIM

NeMo Evaluator does not require a GPU to run. Inference is handled by NIM. For details, see NIM Hardware Support.

The following is the default hardware recommendation for Evaluator software.

Software	CPU	Mem (GB)
Evaluator Container	2	1
Evaluation Job	2	1
Nemo Datastore	2	1
Argo Workflows	1	2
PostgreSQL	2	1
Milvus¹	64	32

¹Milvus is optional software for Retriever and RAG evaluations only. For more information, see Deploy the NeMo Evaluator Microservice.