Reference

RL Framework Compatibility

View as Markdown

Reference for NeMo Gym version compatibility with supported training frameworks.

Ecosystem for training framework integrations and NeMo RL GRPO for training with NeMo Gym.

NeMo RL Container

The following table maps NeMo Gym versions to compatible NeMo RL containers. Use the latest version when possible; the table provides historical compatibility for users who cannot upgrade.

Unsloth

The NeMo Gym integration with Unsloth is tested on unsloth==2026.1.4 and unsloth_zoo==2026.1.4. Other versions are not guaranteed to work.

Unsloth for the Unsloth training tutorial.