> This page is for version 0.6.0.
> For other versions, use one of these documentation indexes:
> - Main (default): https://docs.nvidia.com/nemo/gym/main/llms.txt
> - 0.7.0: https://docs.nvidia.com/nemo/gym/v0.7.0/llms.txt
> - 0.6.0: https://docs.nvidia.com/nemo/gym/v0.6.0/llms.txt
> - 0.5.1: https://docs.nvidia.com/nemo/gym/v0.5.1/llms.txt
> - 0.5.0: https://docs.nvidia.com/nemo/gym/v0.5.0/llms.txt
> - 0.4.0: https://docs.nvidia.com/nemo/gym/v0.4.0/llms.txt
> - 0.3.0: https://docs.nvidia.com/nemo/gym/v0.3.0/llms.txt
> - 0.2.1: https://docs.nvidia.com/nemo/gym/v0.2.1/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://docs.nvidia.com/nemo/gym/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://docs.nvidia.com/nemo/gym/_mcp/server.

# RL Framework Compatibility

> NeMo Gym compatibility with RL training frameworks (NeMo RL, TRL, Unsloth)

Reference for NeMo Gym version compatibility with supported training frameworks.

---

## NeMo RL Container

The following table shows which NeMo Gym version each published NeMo RL container bundles and the model recipe that container supports. NeMo Gym and NeMo RL release independently, so not every NeMo Gym version has a matching NeMo RL image.

**Single source of truth:** When a tutorial or install page needs a container, use the value from this table for the relevant Gym version and recipe. Do not hard-code a different tag elsewhere without a comment pointing back here.

**v0.3.0 exception:** NeMo Gym v0.3.0 paired with Nemotron 3 Ultra has no pre-built NGC container that packaged Gym, so this row references the `ultra-v3` Dockerfile. That is a one-off.

The latest published pairing is NeMo RL v0.7.0 with NeMo Gym v0.4.0.

Match the container to your **model recipe**, not only your NeMo Gym version. For example, the [NeMo RL GRPO](/tutorials/training-tutorials/nemo-rl-grpo) tutorial trains Nemotron Nano 9B v2 and uses the Nano NGC container from the v0.1.1 row below—not the v0.3.0 Ultra Dockerfile.

| NeMo Gym Version | Container / Docker File                                                                                                               | Recipe                                                                                              |
| ---------------- | ------------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------- |
| v0.4.0           | [`nvcr.io/nvidia/nemo-rl:v0.7.0`](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-rl/tags?version=v0.7.0)                  | [Nemotron 3 Super](/model-recipes/nemotron-3-super)                                                 |
| v0.3.0           | [Dockerfile](https://github.com/NVIDIA-NeMo/RL/blob/ultra-v3/docker/Dockerfile)                                                       | [Nemotron 3 Ultra](https://github.com/NVIDIA-NeMo/RL/blob/ultra-v3/docs/guides/nemotron-3-ultra.md) |
| v0.2.0           | [`nvcr.io/nvidia/nemo-rl:v0.5.0.nemotron_3_super`](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-rl/tags?version=v0.5.0) | [Nemotron 3 Super](/model-recipes/nemotron-3-super)                                                 |
| v0.1.1           | [`nvcr.io/nvidia/nemo-rl:v0.4.0.nemotron_3_nano`](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo-rl/tags?version=v0.4.0)  | [Nemotron 3 Nano](/model-recipes/nemotron-3-nano)                                                   |

> **Note**
>
> For end-to-end setup and training instructions, see the [NeMo RL GRPO tutorial](/tutorials/training-tutorials/nemo-rl-grpo).

---

## Unsloth

The NeMo Gym integration with Unsloth is tested on `unsloth==2026.1.4` and `unsloth_zoo==2026.1.4`. Other versions are not guaranteed to work.

> **Note**
>
> For setup and training instructions, see the [Unsloth tutorial](/tutorials/training-tutorials/unsloth).

---

## VeRL

NeMo Gym 0.2.1+ is compatible with verl pinned to the commit in [`REQUIRED_VERL.txt`](https://github.com/verl-project/verl-recipe/blob/main/nemo_gym/REQUIRED_VERL.txt), tested on the `verlai/verl:vllm017.latest` container (vLLM 0.17.0). Other versions are not guaranteed to work.

> **Note**
>
> For setup and training instructions, see the [Training with VeRL tutorial](/tutorials/training-tutorials/verl).