Skip to main content
Ctrl+K
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub

Table of Contents

Basic Usage

  • Evaluate Checkpoints Trained by NeMo Framework

Advanced

  • Use Ray Serve for Multi-Instance Evaluations
  • Evaluation Adapters
  • Evaluate LLMs Using Log-Probabilities
  • Run Evaluation Using a Task Without a Pre-Defined Config
  • Add On-Demand Evaluation Packages

Development

  • Build and Test the Documentation
  • API Reference
    • nemo_eval
      • nemo_eval.utils
        • nemo_eval.utils.base
        • nemo_eval.utils.api
        • nemo_eval.utils.ray_deploy
      • nemo_eval.adapters
        • nemo_eval.adapters.interceptors
        • nemo_eval.adapters.utils
        • nemo_eval.adapters.server
      • nemo_eval.api
      • nemo_eval.package_info
  • API Reference

API Reference#

This page contains auto-generated API reference documentation [1].

  • nemo_eval
    • nemo_eval.utils
      • nemo_eval.utils.base
      • nemo_eval.utils.api
      • nemo_eval.utils.ray_deploy
    • nemo_eval.adapters
      • nemo_eval.adapters.interceptors
        • nemo_eval.adapters.interceptors.logging_interceptor
        • nemo_eval.adapters.interceptors.reasoning_interceptor
        • nemo_eval.adapters.interceptors.endpoint_interceptor
        • nemo_eval.adapters.interceptors.system_message_interceptor
        • nemo_eval.adapters.interceptors.types
      • nemo_eval.adapters.utils
      • nemo_eval.adapters.server
    • nemo_eval.api
    • nemo_eval.package_info
[1]

Created with sphinx-autodoc2

previous

Build and Test the Documentation

next

nemo_eval

NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.