Skip to main content
Ctrl+K
NeMo Eval - Home NeMo Eval - Home

NeMo Eval

  • GitHub
NeMo Eval - Home NeMo Eval - Home

NeMo Eval
  • GitHub

Table of Contents

Basic Usage

  • Evaluate Checkpoints Trained by NeMo Framework

Advanced

  • Use Ray Serve for Multi-Instance Evaluations
  • Evaluation Adapters
  • Evaluate LLMs Using Log-Probabilities
  • Run Evaluation Using a Task Without a Pre-Defined Config
  • Add On-Demand Evaluation Packages

Development

  • Build and Test the Documentation
  • API Reference
    • nemo_eval
      • nemo_eval.utils
        • nemo_eval.utils.base
        • nemo_eval.utils.api
        • nemo_eval.utils.ray_deploy
      • nemo_eval.adapters
        • nemo_eval.adapters.interceptors
        • nemo_eval.adapters.utils
        • nemo_eval.adapters.server
      • nemo_eval.api
      • nemo_eval.package_info
  • Overview: module code

All modules for which code is available

  • nemo_eval.adapters.interceptors.endpoint_interceptor
  • nemo_eval.adapters.interceptors.logging_interceptor
  • nemo_eval.adapters.interceptors.reasoning_interceptor
  • nemo_eval.adapters.interceptors.system_message_interceptor
  • nemo_eval.adapters.interceptors.types
  • nemo_eval.adapters.server
  • nemo_eval.adapters.utils
  • nemo_eval.api
  • nemo_eval.utils.api
  • nemo_eval.utils.base
  • nemo_eval.utils.ray_deploy
NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.