Local Exporter (local
)#
Exports artifacts and optional summaries to the local filesystem. When used with remote executors, stages artifacts from remote locations. Can produce consolidated JSON or CSV summaries of metrics.
Usage#
Export evaluation results and artifacts to your local filesystem with optional summary reports.
Export artifacts and generate summary reports locally:
# Basic export to current directory
nemo-evaluator-launcher export 8abcd123 --dest local
# Export with JSON summary to custom directory
nemo-evaluator-launcher export 8abcd123 --dest local --format json --output-dir ./evaluation-results/
# Export multiple runs with CSV summary and logs included
nemo-evaluator-launcher export 8abcd123 9def4567 --dest local --format csv --copy-logs --output-dir ./results
# Export only specific metrics to a custom filename
nemo-evaluator-launcher export 8abcd123 --dest local --format json --log-metrics accuracy --log-metrics bleu --output-filename model_metrics.json
Export results programmatically with flexible configuration:
from nemo_evaluator_launcher.api.functional import export_results
# Basic local export with JSON summary
export_results(
invocation_ids=["8abcd123"],
dest="local",
config={
"format": "json",
"output_dir": "./results"
}
)
# Export multiple runs with comprehensive configuration
export_results(
invocation_ids=["8abcd123", "9def4567"],
dest="local",
config={
"output_dir": "./evaluation-outputs",
"format": "csv",
"copy_logs": True,
"only_required": False, # Include all artifacts
"log_metrics": ["accuracy", "f1_score", "perplexity"],
"output_filename": "comprehensive_results.csv"
}
)
# Export artifacts only (no summary)
export_results(
invocation_ids=["8abcd123"],
dest="local",
config={
"output_dir": "./artifacts-only",
"format": None, # No summary file
"copy_logs": True
}
)
Configure local export in your evaluation YAML file for automatic export on completion:
execution:
auto_export:
destinations: ["local"]
export:
local:
format: "json"
output_dir: "./results"
Key Configuration#
Parameter |
Type |
Description |
Default |
---|---|---|---|
|
str |
Destination directory for exported results |
|
|
bool |
Include logs alongside artifacts |
|
|
bool |
Copy only required and optional artifacts; excludes other files |
|
|
str | null |
Summary format: |
|
|
list[str] |
Filter metrics by name (exact or substring match) |
All metrics |
|
str |
Override default summary filename ( |
|