Overview

View as Markdown

We have hands-on tutorials with supported training frameworks to help you train with NeMo Gym environments. If you’re interested in integrating another training framework, see the Training Framework Integration Guide.

See training-approaches for a refresher on when to use GRPO, SFT, or DPO.

RL (GRPO)

NeMo RL

Tutorial-series: GRPO training to improve multi-step tool calling on the Workplace Assistant environment, scaling from single-node to multi-node training.

nemo rlgrpo3-5 hours
OpenRLHF

Review the agent executor for using NeMo Gym environments with OpenRLHF.

openrlhf
Unsloth

GRPO training on instruction following and reasoning environments.

unslothsingle-gpu30 min
NeMo Customizer

Coming soon

nemo customizerin progress
VeRL

Coming soon

verlin progress

Multi-Environment Training

Multi-Environment Training

Run multiple training environments simultaneously for rollout collection.

multi-environmentmulti-verifier

SFT & DPO

Offline Training with Rollouts

Transform rollouts into training data for supervised fine-tuning (SFT) and direct preference optimization (DPO).

sftdpo