This page is for version nightly (default).
For other versions, use one of these documentation indexes:
- nightly (default): https://docs.nvidia.com/nemo/evaluator/nightly/llms.txt
Deployment Matrix
| Environment | Sharding | Live Serve | Regression Gate | Effort |
|---|---|---|---|---|
| Local Deployment | Manual via env vars | nel serve | nel compare | Minimal |
| Docker Compose | Per-container env vars | docker-compose service | Script | Low |
| SLURM | nel eval run with executor config | nel serve | sbatch chain | Medium |
| Kubernetes Deployment | Indexed Job | Deployment + Service | CI pipeline | Medium |
| Ray Deployment | @ray.remote tasks | N/A | Script | Medium |
| GitLab CI | CI variables per job | N/A | regression:check stage | Low |