Concepts#

Use this section to understand how NeMo Evaluator works at a high level. Start with the evaluation model, then read about adapters and deployment choices.

Evaluation Model

Core evaluation types, OpenAI-compatible endpoints, and metrics.

Evaluation Model
Execution backend

Your runtime execution environment

Execution Backend
Framework Definition Files

YAML configuration files that integrate evaluation frameworks into NeMo Evaluator.

Framework Definition Files
Interceptors

Advanced request/response processing with configurable interceptor pipelines.

Interceptors