Setup and Installation Issues#
Solutions for getting NeMo Evaluator up and running, including installation problems, authentication setup, and model deployment issues.
Common Setup Problems#
Before diving into specific issues, verify your basic setup with these quick checks:
# Verify core packages are installed
pip list | grep nvidia
# Check for missing evaluation frameworks
python -c "from nemo_evaluator import show_available_tasks; show_available_tasks()"
# Verify HuggingFace token
huggingface-cli whoami
# Test token access
python -c "import os; print('HF_TOKEN set:', bool(os.environ.get('HF_TOKEN')))"
# Check if deployment server is running
# Use /health for vLLM, SGLang, NIM deployments
# Use /v1/triton_health for NeMo/Triton deployments
curl -I http://0.0.0.0:8080/health
# Verify GPU availability
nvidia-smi
Setup Categories#
Choose the category that matches your setup issue:
Installation Issues
Module import errors, missing dependencies, and framework installation problems.
Authentication Setup
HuggingFace tokens, dataset access permissions, and gated model authentication.