Concepts#
Use this section to understand how NeMo Evaluator works at a high level. Start with the evaluation model, then read about adapters and deployment choices.
Evaluation Model
Core evaluation types, OpenAI-compatible endpoints, and metrics.
Execution Backend
Your runtime execution environment.
Evaluation Output
Standardized output structure across all harnesses and tasks is what makes Evaluator powerful.
Framework Definition Files
YAML configuration files that integrate evaluation frameworks into NeMo Evaluator.
Interceptors
Advanced request/response processing with configurable interceptor pipelines.