This page is for version Main (default).
For other versions, use one of these documentation indexes:
- Main (default): https://docs.nvidia.com/nemo/gym/main/llms.txt
- 0.7.0: https://docs.nvidia.com/nemo/gym/v0.7.0/llms.txt
- 0.6.0: https://docs.nvidia.com/nemo/gym/v0.6.0/llms.txt
- 0.5.1: https://docs.nvidia.com/nemo/gym/v0.5.1/llms.txt
- 0.5.0: https://docs.nvidia.com/nemo/gym/v0.5.0/llms.txt
- 0.4.0: https://docs.nvidia.com/nemo/gym/v0.4.0/llms.txt
- 0.3.0: https://docs.nvidia.com/nemo/gym/v0.3.0/llms.txt
- 0.2.1: https://docs.nvidia.com/nemo/gym/v0.2.1/llms.txt
Each guide builds on the Quickstart and shows only the parts of the config that change. Field details are in the Configuration Reference.
Multi-Node vLLM
Run many replicas, or one very large instance, across nodes, and learn when the Ray Serve gateway takes over.
Prefill/Decode Disaggregation
Serve a model as separate prefill and decode tiers behind a router.
Node Pools and Ray
Give a judge or scorer nodes of its own, and span a Ray cluster across pools.
Custom Harness
Run your own script instead of gym eval run.
Resumable Runs
Continue automatically after a time limit, preemption, or node failure.