Skip to main content
Ctrl+K
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub

Table of Contents

Basic Usage

  • Evaluate Checkpoints Trained by NeMo Framework
  • Evaluate Automodel Checkpoints Trained by NeMo Framework

Advanced

  • Use Ray Serve for Multi-Instance Evaluations
  • Evaluation Adapters
  • Evaluate LLMs Using Log-Probabilities
  • Run Evaluation Using a Task Without a Pre-Defined Config
  • Add On-Demand Evaluation Packages

Development

  • Build and Test the Documentation
  • API Reference
    • nemo_eval
      • nemo_eval.utils
        • nemo_eval.utils.base
      • nemo_eval.package_info
      • nemo_eval.api
  • nemo_evaluator.adapters

nemo_evaluator.adapters#

Subpackages#

  • nemo_evaluator.adapters.caching
    • nemo_evaluator.adapters.caching.diskcaching
  • nemo_evaluator.adapters.interceptors
    • nemo_evaluator.adapters.interceptors.caching_interceptor
    • nemo_evaluator.adapters.interceptors.endpoint_interceptor
    • nemo_evaluator.adapters.interceptors.logging_interceptor
    • nemo_evaluator.adapters.interceptors.payload_modifier_interceptor
    • nemo_evaluator.adapters.interceptors.progress_tracking_interceptor
    • nemo_evaluator.adapters.interceptors.raise_client_error_interceptor
    • nemo_evaluator.adapters.interceptors.reasoning_interceptor
    • nemo_evaluator.adapters.interceptors.response_stats_interceptor
    • nemo_evaluator.adapters.interceptors.system_message_interceptor
  • nemo_evaluator.adapters.reports
    • nemo_evaluator.adapters.reports.templates
      • nemo_evaluator.adapters.reports.templates.simple_template
    • nemo_evaluator.adapters.reports.post_eval_report_hook

Submodules#

  • nemo_evaluator.adapters.adapter_config
  • nemo_evaluator.adapters.decorators
  • nemo_evaluator.adapters.registry
  • nemo_evaluator.adapters.server
  • nemo_evaluator.adapters.types
On this page
  • Subpackages
  • Submodules
NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.