NeMo Gym Tutorials

Hands-on learning experiences that guide you through building, training, and deploying AI agents with NeMo Gym.

Tip

New to NeMo Gym? Begin with the Get Started section for a guided tutorial experience from installation through your first verified agent. Return here after completing those tutorials to learn about advanced topics like additional rollout collection methods and training data generation.

---

Rollout Collection and Training Data

Implement rollout generation and training data preparation for RL, SFT, and DPO.

Offline Training with Rollouts

Transform rollouts into training data for supervised fine-tuning (SFT) and direct preference optimization (DPO).

sft dpo

Offline Training with Rollouts (SFT/DPO)

RL Training with NeMo RL

Train a model with NeMo RL. Learn how to set up NeMo Gym + NeMo RL training environment, run tests, prepare data, and launch single and multi-node training runs.

sft dpo

RL Training with NeMo RL