Skip to main content
Ctrl+K
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub

Table of Contents

Basic Usage

  • Evaluate Checkpoints Trained by NeMo Framework
  • Evaluate Automodel Checkpoints Trained by NeMo Framework

Advanced

  • Use Ray Serve for Multi-Instance Evaluations
  • Evaluation Adapters
  • Evaluate LLMs Using Log-Probabilities
  • Run Evaluation Using a Task Without a Pre-Defined Config
  • Add On-Demand Evaluation Packages

Development

  • Build and Test the Documentation
  • API Reference
    • nemo_eval
      • nemo_eval.utils
        • nemo_eval.utils.base
      • nemo_eval.package_info
      • nemo_eval.api
  • nemo_evaluator.core.entrypoint

nemo_evaluator.core.entrypoint#

Module Contents#

Functions#

get_args

run

run_eval

show_available_tasks

API#

nemo_evaluator.core.entrypoint.get_args() → argparse.Namespace#
nemo_evaluator.core.entrypoint.run(args) → None#
nemo_evaluator.core.entrypoint.run_eval() → None#
nemo_evaluator.core.entrypoint.show_available_tasks() → None#
On this page
  • Module Contents
    • Functions
    • API
      • get_args()
      • run()
      • run_eval()
      • show_available_tasks()
NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.