For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
DocumentationAPI Reference
DocumentationAPI Reference
  • Documentation
    • Home
  • About
    • Concepts
    • Ecosystem
  • Get Started
    • Quickstart
    • Detailed Setup Guide
    • Install from PyPI
    • Rollout Collection
  • Agent Server
  • Model Server
    • vLLM
  • Resources Server
  • Data
    • Prepare and Validate
    • Download from Hugging Face
    • Prompt Config
  • Environment Tutorials
    • Single-Step Environment
    • Multi-Step Environment
    • Stateful Environment
    • Real-World Environment
    • Integrate external libraries
    • Aggregate Metrics
    • LLM-as-Judge Verification
  • Benchmarks
    • Run benchmarks
    • Add a benchmark
    • Design a customer evaluation
  • Training Tutorials
    • NeMo RL
    • Unsloth
    • Multi-Environment Training
    • Offline Training (SFT/DPO)
  • Model Recipes
    • Nemotron 3 Nano
    • Nemotron 3 Super
  • Infrastructure
    • Deployment Topology
    • Engineering Notes
  • Reference
    • Configuration
    • RL Framework Compatibility
    • CLI Commands
    • FAQ
  • Troubleshooting
    • Configuration Errors
  • Contribute
    • Development Setup
    • Environments
    • Integrate RL Frameworks
NVIDIANVIDIA
Developer-friendly docs for your API
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2026, NVIDIA Corporation.

LogoLogoNeMo Gym
On this page
  • Ways to Contribute
  • Before You Start

Overview

||View as Markdown|
Previous

Configuration Errors

Next

Development Setup

Welcome! We are excited to have you contribute to NeMo Gym. Whether you are adding new training environments, integrating RL frameworks, improving documentation, or fixing bugs, your contributions help advance RL training.

Ways to Contribute

Add Environments

New environments expand Gym’s training capabilities.

  • Novel training environments (coding, reasoning, tool use, games, and so on)
  • Benchmark integrations (such as SWE-Bench and Tau Bench)

→ Refer to contribute-environments for guidance.

Integrate RL Frameworks

Have a preferred training framework? Help integrate it with NeMo Gym.

→ Refer to training-framework-integration for integration guides.

Improve Documentation
  • New tutorials and advanced guides
  • Code examples and best practices
  • API documentation improvements
Report Bugs & Fix Issues
  • Found a bug? Open an issue with reproduction steps.
  • Want to fix one? Check open issues for bugs to tackle.
Features & Enhancements

Have an idea for a new feature or improvement? Open an issue to start a discussion!

Before You Start

All contributions require signed commits and DCO sign-off. Refer to development-setup for environment setup, CI/CD requirements, and commit signing instructions.

Not sure where to start? Check our open issues or create a new issue to discuss your idea.