Support Information for NVIDIA NeMo Evaluator

This documentation describes the software and hardware that NVIDIA NeMo Evaluator supports.

Software Support

You need the following software to use NeMo Evaluator:

• Linux operating systems (Ubuntu 20.04 or later recommended)

• Docker >= 23.0.1

• Kubernetes Version >= v1.26.0

Hardware Support

The software used in an evaluation are the following:

• Nemo Evaluator Microservice

  • Evaluator container (assigned to the pod)

  • Evaluator dependencies

    • Argo Workflows

    • PostgreSQL

    • Milvus

  • Evaluation jobs

• Nemo Microservice Dependencies

  • NeMo Data Store

• NIM Models

  • NIM for LLMs

NeMo Evaluator does not require a GPU to run. Inference is handled by NIM for LLMs. For details, see NIM Hardware Support.

The following is the default hardware recommendation for Evaluator software.

Software	CPU	Mem (GB)
Evaluator Container	2	1
Evaluation Job	2	1
Nemo Datastore	2	1
Argo Workflows	1	2
PostgreSQL	2	1
Milvus¹	64	32

¹Milvus is optional software for Retriever and RAG evaluations only. For more information, see NeMo Evaluator Deployment Guide.