References#

Comprehensive reference documentation for NeMo Evaluator APIs, functions, and configuration options.

CLI vs. Programmatic Usage#

The NeMo Evaluator SDK supports two usage patterns:

  1. CLI Usage (Recommended): Use nemo-evaluator and/or nemo-evaluator-launcher binaries which parses command line arguments

  2. Programmatic Usage: Use Python API with configuration objects

When to Use Which:

  • CLI: For command-line tools, scripts, and simple automation

  • Programmatic: For building custom applications, workflows, and integration with other systems

API References#

NeMo Evaluator Launcher CLI

Comprehensive command-line interface reference with all commands, options, and examples.

NeMo Evaluator Launcher CLI Reference (nemo-evaluator-launcher)
NeMo Evaluator Launcher API

Complete Python API reference for programmatic evaluation workflows and job management.

Python API
Configuration Schema

Configuration reference for NeMo Evaluator Launcher with examples for all executors and deployment types.

Configuration
NeMo Evaluator CLI

Comprehensive command-line interface reference with all commands, options, and examples.

NeMo Evaluator CLI Reference (nemo-evaluator)
NeMo Evaluator Python API

Complete Python API reference for programmatic evaluation workflows and job management.

nemo_evaluator.api