Skip to main content

Ctrl+K

NeMo-RL

GitHub

NeMo-RL

GitHub

Table of Contents

🖥️ Environment Start

Run on Your Local Workstation
Set Up Clusters

🚀 E2E Examples

GRPO on DeepScaler
SFT on OpenMathInstruct-2

📚 Guides

Add New Models
Supervised Fine-Tuning in NeMo RL
Direct Preference Optimization in NeMo RL
An in-depth Walkthrough of DAPO in NeMo RL
An in-depth Walkthrough of GRPO in NeMo RL
GRPO on DeepScaler
Solve a Sliding Puzzle Using GRPO
Reward Model Training in NeMo RL
Environments for GRPO Training
Evaluation
DeepSeek-V3
Model Quirks
Train with Async GRPO

🐳 Containers

Build Docker Images

🛠️ Development

Test NeMo RL
Documentation Development
Debug NeMo RL Applications
Profile GPU with Nsys
FP8 Quantization in NeMo RL
Experiment with Custom vLLM
API Reference
- nemo_rl

📐 Design Docs

Design and Philosophy
Padding in NeMo RL
Logger
uv in NeMo RL
Data Format
Generation Interface
Exporting Checkpoints to Hugging Face Format
Loss functions in NeMo RL
FSDP2 Parallel Plan
Training Backends
Sequence Packing and Dynamic Batching
Environment Variable Precedence in NeMo RL

API Reference
nemo_rl
nemo_rl.environments

`nemo_rl.environments`#

Submodules#

nemo_rl.environments.dapo_math_verifier
nemo_rl.environments.penguin
nemo_rl.environments.metrics
nemo_rl.environments.code_environment
nemo_rl.environments.math_environment
nemo_rl.environments.reward_model_environment
nemo_rl.environments.utils
nemo_rl.environments.vlm_environment
nemo_rl.environments.rewards
nemo_rl.environments.interfaces

previous

nemo_rl.distributed.batched_data_dict

next

nemo_rl.environments.dapo_math_verifier

On this page

Submodules

Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.