> For clean Markdown of any page, append .md to the page URL. > For a complete documentation index, see https://docs.nvidia.com/nemo/gym/llms.txt. > For full documentation content, see https://docs.nvidia.com/nemo/gym/llms-full.txt. # NeMo Gym Documentation > NeMo Gym is an open-source library for building reinforcement learning (RL) training environments for large language models (LLMs) [NeMo Gym](https://github.com/NVIDIA-NeMo/Gym) is a library for building reinforcement learning (RL) training environments for large language models (LLMs). NeMo Gym provides infrastructure to develop environments, scale rollout collection, and integrate seamlessly with your preferred training framework. Install, run servers, and collect your first rollouts. start here 5 min Build single-step, multi-step, and real-world environments. Train with NeMo RL, OpenRLHF, Unsloth, and more. *** ## Introduction to NeMo Gym Understand NeMo Gym's purpose and core components before diving into tutorials. Motivation and benefits of NeMo Gym. motivation benefits Training approaches, core components, configuration, verification, and RL terminology. sft rl rlvr environments agents models resources Understand how NeMo Gym fits within the RL environment ecosystem. ecosystem integrations ## Get Started Install and run NeMo Gym to start collecting rollouts. Install, start servers, and collect your first rollouts in one page. start here 5 min Step-by-step installation with requirements, configuration, and troubleshooting. 15 min environment configuration Generate batches of scored interactions and view them with the rollout viewer. 10 min rollouts training-data ## Environment Configuration Configure and customize environment components and prepare datasets. Orchestrate rollouts, tool calling, and verification. orchestration rollouts Configure LLM inference backends including vLLM. inference vllm Define tasks, tools, and verification logic for your environment. environments verification Prepare and validate training datasets. datasets jsonl ## Environment Tutorials Learn how to build custom training environments for various RL scenarios. Build a complete training environment from scratch. beginner foundational ## Training Tutorials Train models using NeMo Gym with your preferred RL framework. Hands-on tutorials with NeMo RL, Unsloth, and more. grpo Run multiple training environments simultaneously for rollout collection. multi-environment multi-verifier Transform rollouts into SFT and DPO format. sft dpo ## Infrastructure Deploy NeMo Gym and plan cluster resources for training. Production deployment patterns and configurations. deployment topology ## Contribute Contribute to NeMo Gym development. Contribute new environments or integrate existing benchmarks. environments Implement NeMo Gym integration into a new training framework. training-integration ***