Ecosystem | NeMo Gym

NeMo Gym is integrated with the broader agentic ecosystem. We would love your contribution! Open a PR to add an integration, or file an issue to share what would be valuable for you.

Environment Libraries

Seamlessly combine environments and benchmarks from other libraries alongside NeMo Gym environments, with access to over 1,000 community-contributed environments across integrated libraries.

Aviary
Harbor
OpenEnv
Reasoning Gym
Verifiers

Training Framework Libraries

Use environments for SFT and RL training. If you’re interested in integrating another training framework, see the Training Framework Integration Guide.

NeMo RL
Unsloth
VeRL

Agent Harnesses

Agent harnesses are available out of the box for evaluation and training. Some examples:

OpenHands - software engineering agent harness
Mini SWE Agent - software engineering agent harness
LangGraph - agent patterns built with LangGraph (reflection, orchestration, parallel thinking)

NeMo Gym is a component of NVIDIA NeMo, a GPU-accelerated platform for training generative AI models and optimizing AI agents.

Depending on your workflow, you may also find these libraries useful:

Data

Library	Purpose
NeMo Curator	Scalable data preprocessing and curation
NeMo Data Designer	Generate synthetic training data from scratch or seed examples
NeMo Safe Synthesizer	Generate privacy-safe synthetic copies of sensitive datasets
NeMo Anonymizer	Detect and replace sensitive data

Evaluation & Training

Library	Purpose
NeMo Gym	Evaluate and improve models and agents using environments (this project)
NeMo Evaluator	Model evaluation and benchmarking
NeMo RL	Scalable post-training with GRPO, DPO, and SFT
NeMo Megatron-Bridge	Pretraining and fine-tuning with Megatron-Core
NeMo AutoModel	PyTorch native training for Hugging Face models

Deployment

Library	Purpose
NeMo Agent Toolkit	Connect and optimize teams of AI agents
NeMo Guardrails	Enforce safety and policy rules
NeMo Retriever	Document extraction and retrieval for RAG pipelines