NeMo Evaluator Libraries#

Select a library for your evaluation workflow:

NeMo Evaluator Launcher

Start here - Unified CLI and Python API for running evaluations across local, cluster, and hosted environments.

NeMo Evaluator Launcher
NeMo Evaluator

Advanced usage - Direct access to evaluation containers and adapter architecture for custom integrations.

NeMo Evaluator

The Launcher orchestrates the Core Evaluation Engine, using identical containers to ensure consistent results.