NeMo Evaluator Libraries#

Select a library for your evaluation workflow:

NeMo Evaluator Launcher

Start here - Unified CLI and Python API for running evaluations across local, cluster, and hosted environments.

NeMo Evaluator Launcher
NeMo Evaluator

Advanced usage - Direct access to core evaluation logic for custom integrations.

NeMo Evaluator

The Launcher orchestrates the NeMo Evaluator containers using identical underlying code to ensure consistent results.