Exporters#

Exporters move evaluation results and artifacts from completed runs to external destinations for analysis, sharing, and reporting. They provide flexible options for integrating evaluation results into your existing workflows and tools.

How to Set an Exporter#

nemo-evaluator-launcher export <id1> [<id2> ...] \
  --dest <local|gsheets|wandb|mlflow> \
  [options]
from nemo_evaluator_launcher.api.functional import export_results

export_results(
    invocation_ids=["8abcd123"], 
    dest="local", 
    config={
        "format": "json", 
        "output_dir": "./out"
    }
)

Choosing an Exporter#

Select exporters based on your analysis and reporting needs:

Local Files

Export results and artifacts to local or network file systems for custom analysis and archival.

Local Exporter (local)
Weights & Biases

Track metrics, artifacts, and run metadata in W&B for comprehensive experiment management.

Weights & Biases Exporter (wandb)
MLflow

Export metrics and artifacts to MLflow Tracking Server for centralized ML lifecycle management.

MLflow Exporter (mlflow)
Google Sheets

Export metrics to Google Sheets for easy sharing, reporting, and collaborative analysis.

Google Sheets Exporter (gsheets)

You can configure multiple exporters simultaneously to support different stakeholder needs and workflow integration points.