Support Information for NVIDIA NeMo Evaluator#

This documentation describes the software and hardware that NVIDIA NeMo Evaluator supports.

Software Support#

You need the following software to use NeMo Evaluator:

  • Linux operating systems (Ubuntu 20.04 or later recommended)

  • Docker >= 23.0.1

  • Kubernetes Version >= v1.26.0

Hardware Support#

The software used in an evaluation are the following:

  • Nemo Evaluator Microservice

    • Evaluator container (assigned to the pod)

    • Evaluator dependencies

    • Evaluation jobs

  • Nemo Microservice Dependencies

    • NeMo Data Store

  • NIM Models

NeMo Evaluator does not require a GPU to run. Inference is handled by NIM. For details, see NIM Hardware Support.

The following is the default hardware recommendation for Evaluator software.

Software

CPU

Mem (GB)

Evaluator Container

2

1

Evaluation Job

2

1

Nemo Datastore

2

1

Argo Workflows

1

2

PostgreSQL

2

1

Milvus¹

64

32

¹Milvus is optional software for Retriever and RAG evaluations only. For more information, see Deploy the NeMo Evaluator Microservice.