RL Framework Compatibility#
Reference for NeMo Gym version compatibility with supported training frameworks.
See also
RL Environment Ecosystem for training framework integrations and RL Training with NeMo RL using GRPO for NeMo RL GRPO training with NeMo Gym.
NeMo RL Container#
The following table maps NeMo Gym versions to compatible NeMo RL containers. Use the latest version when possible; the table provides historical compatibility for users who cannot upgrade.
NeMo Gym Version |
NeMo RL Container |
Recipe |
|---|---|---|
v0.1.1 |
||
v0.2.0 |
Unsloth#
The NeMo Gym integration with Unsloth is tested on unsloth==2026.1.4 and unsloth_zoo==2026.1.4. Other versions are not guaranteed to work.
See also
RL Training with Unsloth for the Unsloth training tutorial.