> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/gym/_mcp/server.

# Overview

We have hands-on tutorials with supported training frameworks to help you train with NeMo Gym environments. If you're interested in integrating another training framework, see the [Training Framework Integration Guide](/v0.2/contribute/rl-framework-integration).

> **Tip**
>
> See [training-approaches](/v0.2/about/concepts/training-approaches) for a refresher on when to use GRPO, SFT, or DPO.

## RL (GRPO)

#### [NeMo RL](/v0.2/training-tutorials/nemo-rl-grpo)

Tutorial-series: GRPO training to improve multi-step tool calling on the Workplace Assistant environment, scaling from single-node to multi-node training.

nemo rl

grpo

3-5 hours

#### [Unsloth](/v0.2/training-tutorials/unsloth)

GRPO training on instruction following and reasoning environments.

unsloth

single-gpu

30 min

#### NeMo Customizer

*Coming soon*

nemo customizer

in progress

#### VeRL

*Coming soon*

verl

in progress

### Multi-Environment Training

#### [Multi-Environment Training](/v0.2/training-tutorials/multi-environment-training)

Run multiple training environments simultaneously for rollout collection.

multi-environment

multi-verifier

## SFT & DPO

#### [Offline Training with Rollouts](/v0.2/training-tutorials/offline-training-w-rollouts)

Transform rollouts into training data for supervised fine-tuning (SFT) and direct preference optimization (DPO).

sft

dpo

## Docs

- [NeMo RL](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo.md): 
- [About Workplace Assistant](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo/about-workplace-assistant.md): 
- [Gym Configuration](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo/gym-configuration.md): 
- [NeMo RL Configuration](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo/nemo-rl-configuration.md): 
- [Setup](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo/setup.md): 
- [Single Node Training](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo/single-node-training.md): 
- [Multi-Node Training](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/nemo-rl-grpo/multi-node-training.md): 
- [Unsloth](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/unsloth.md): 
- [Multi-Environment Training](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/multi-environment-training.md): 
- [Offline Training (SFT/DPO)](https://docs.nvidia.com/nemo/gym/v0.2.1/training-tutorials/offline-training-w-rollouts.md):