For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
DocumentationAPI Reference
DocumentationAPI Reference
  • About
    • Concepts
    • Architecture
    • Ecosystem
    • Release Notes
  • Get Started
    • Prerequisites
    • Installation
    • Quickstart
  • Agent Server
  • Model Server
    • vLLM
  • Resources Server
  • Data
    • Prepare and Validate
    • Download from Hugging Face
    • Prompt Config
  • Environment Tutorials
    • Single-Step Environment
    • Multi-Step Environment
    • Stateful Environment
    • Real-World Environment
    • Integrate external libraries
    • Add a benchmark
    • Verification Patterns
    • Aggregate Metrics
  • Training Tutorials
    • NeMo RL
    • Unsloth
    • Multi-Environment Training
    • Training with VeRL
    • Offline Training (SFT/DPO)
  • Model Recipes
    • Nemotron 3 Nano
    • Nemotron 3 Super
  • Infrastructure
    • Deployment Topology
    • Engineering Notes
  • Reference
    • Configuration
    • RL Framework Compatibility
    • CLI Commands
    • FAQ
  • Troubleshooting
    • Configuration Errors
  • Contribute
    • Development Setup
    • Environments
    • Integrate RL Frameworks
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Your Privacy Choices | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogoNeMo Gym
On this page
  • NeMo RL Container
  • Unsloth
  • VeRL
Reference

RL Framework Compatibility

||View as Markdown|
Previous

Configuration

Next

CLI Commands

Reference for NeMo Gym version compatibility with supported training frameworks.

NeMo RL Container

The following table maps NeMo Gym versions to compatible NeMo RL containers. Use the latest version when possible; the table provides historical compatibility for users who cannot upgrade.

NeMo Gym VersionContainer / Docker FileRecipe
v0.1.1nvcr.io/nvidia/nemo-rl:v0.4.0.nemotron_3_nanoNemotron 3 Nano
v0.2.0nvcr.io/nvidia/nemo-rl:v0.5.0.nemotron_3_superNemotron 3 Super
v0.3.0DockerfileNemotron 3 Ultra

NeMo RL GRPO for the NeMo RL training tutorial.

Unsloth

The NeMo Gym integration with Unsloth is tested on unsloth==2026.1.4 and unsloth_zoo==2026.1.4. Other versions are not guaranteed to work.

Unsloth for the Unsloth training tutorial.

VeRL

NeMo Gym 0.2.1+ is compatible with verl pinned to the commit in REQUIRED_VERL.txt, tested on the verlai/verl:vllm017.latest container (vLLM 0.17.0). Other versions are not guaranteed to work.

Training with VeRL for the verl training tutorial.