> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo-helix/v0.7.0/documentation/evaluate-models/tutorials/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo-helix/_mcp/server.

# Evaluation Tutorials

Use these tutorials to become familiar with [evaluation with NeMo Helix](/documentation/evaluate-models).

## Before You Start

Set up [a local instance of the platform](/documentation/get-started) for the following tutorials.

#### [Run an LLM Judge Eval](/documentation/evaluate-models/tutorials/run-llm-as-a-judge-evaluation)

Learn how to evaluate a fine-tuned model using the LLM Judge metric with a custom dataset.

intermediate custom evaluation llm judge nemo-evaluator

#### [Define and Run Custom Python Metrics](/documentation/evaluate-models/tutorials/define-and-run-custom-python-metrics)

Learn how to write a domain-specific Python metric, test it locally, and run it through the Evaluator service.

intermediate custom metric remote execution nemo-evaluator

## How It Works

For the conceptual overview of how Evaluator separates definition (library) from execution (platform), see [About Evaluating → How evaluation runs](/documentation/evaluate-models#how-evaluation-runs). For runnable SDK examples, see [SDK Resources](/documentation/evaluate-models/sdk-resources).

## Docs

- [Evaluate Response Quality with LLM-as-a-Judge](https://docs.nvidia.com/nemo-helix/v0.7.0/documentation/evaluate-models/tutorials/run-llm-as-a-judge-evaluation.md): 
- [Define and Run Custom Python Metrics](https://docs.nvidia.com/nemo-helix/v0.7.0/documentation/evaluate-models/tutorials/define-and-run-custom-python-metrics.md):