Skip to main content
Ctrl+K
NeMo-RL - Home NeMo-RL - Home

NeMo-RL

  • GitHub
NeMo-RL - Home NeMo-RL - Home

NeMo-RL
  • GitHub

Table of Contents

🖥️ Environment Start

  • Run on Your Local Workstation
  • Set Up Clusters

🚀 E2E Examples

  • GRPO on DeepScaler
  • SFT on OpenMathInstruct-2

📚 Guides

  • Add New Models
  • Supervised Fine-Tuning in NeMo RL
  • Direct Preference Optimization in NeMo RL
  • An in-depth Walkthrough of GRPO in NeMo RL
  • GRPO on DeepScaler
  • Reward Model Training in NeMo RL
  • Evaluation
  • DeepSeek-V3
  • Model Quirks

🐳 Containers

  • Build Docker Images

🛠️ Development

  • Test NeMo RL
  • Documentation Development
  • Debug NeMo RL Applications
  • Profile GPU with Nsys
  • Experiment with Custom vLLM
  • API Reference
    • nemo_rl
      • nemo_rl.algorithms
        • nemo_rl.algorithms.interfaces
        • nemo_rl.algorithms.utils
        • nemo_rl.algorithms.dpo
        • nemo_rl.algorithms.rm
        • nemo_rl.algorithms.sft
        • nemo_rl.algorithms.grpo
        • nemo_rl.algorithms.loss_functions
      • nemo_rl.converters
        • nemo_rl.converters.huggingface
        • nemo_rl.converters.megatron
      • nemo_rl.data
        • nemo_rl.data.eval_datasets
        • nemo_rl.data.hf_datasets
        • nemo_rl.data.packing
        • nemo_rl.data.datasets
        • nemo_rl.data.interfaces
        • nemo_rl.data.llm_message_utils
        • nemo_rl.data.processors
      • nemo_rl.distributed
        • nemo_rl.distributed.batched_data_dict
        • nemo_rl.distributed.collectives
        • nemo_rl.distributed.model_utils
        • nemo_rl.distributed.named_sharding
        • nemo_rl.distributed.ray_actor_environment_registry
        • nemo_rl.distributed.virtual_cluster
        • nemo_rl.distributed.worker_group_utils
        • nemo_rl.distributed.worker_groups
      • nemo_rl.environments
        • nemo_rl.environments.code_environment
        • nemo_rl.environments.interfaces
        • nemo_rl.environments.math_environment
        • nemo_rl.environments.metrics
        • nemo_rl.environments.utils
      • nemo_rl.evals
        • nemo_rl.evals.answer_parsing
        • nemo_rl.evals.eval
      • nemo_rl.experience
        • nemo_rl.experience.rollouts
      • nemo_rl.metrics
        • nemo_rl.metrics.metrics_utils
      • nemo_rl.models
        • nemo_rl.models.dtensor
        • nemo_rl.models.generation
        • nemo_rl.models.huggingface
        • nemo_rl.models.megatron
        • nemo_rl.models.policy
      • nemo_rl.utils
        • nemo_rl.utils.config
        • nemo_rl.utils.logger
        • nemo_rl.utils.native_checkpoint
        • nemo_rl.utils.nsys
        • nemo_rl.utils.nvml
        • nemo_rl.utils.prefetch_venvs
        • nemo_rl.utils.venvs
        • nemo_rl.utils.checkpoint
        • nemo_rl.utils.flops_formulas
        • nemo_rl.utils.flops_tracker
        • nemo_rl.utils.timer
      • nemo_rl.package_info

📐 Design Docs

  • Design and Philosophy
  • Padding in NeMo RL
  • Logger
  • uv in NeMo RL
  • Data Format
  • Generation Interface
  • Exporting Checkpoints to Hugging Face Format
  • Loss functions in NeMo RL
  • FSDP2 Parallel Plan
  • Training Backends
  • Sequence Packing and Dynamic Batching
  • Environment Variable Precedence in NeMo RL
  • API Reference
  • nemo_rl
  • nemo_rl.distributed
  • nemo_rl.distributed.ray_actor_environment_registry

nemo_rl.distributed.ray_actor_environment_registry#

Module Contents#

Functions#

get_actor_python_env

Data#

ACTOR_ENVIRONMENT_REGISTRY

API#

nemo_rl.distributed.ray_actor_environment_registry.ACTOR_ENVIRONMENT_REGISTRY: dict[str, str]#

None

nemo_rl.distributed.ray_actor_environment_registry.get_actor_python_env(actor_class_fqn: str) → str#

previous

nemo_rl.distributed.named_sharding

next

nemo_rl.distributed.virtual_cluster
On this page
  • Module Contents
    • Functions
    • Data
    • API
      • ACTOR_ENVIRONMENT_REGISTRY
      • get_actor_python_env()
NVIDIA NVIDIA
Privacy Policy | Manage My Privacy | Do Not Sell or Share My Data | Terms of Service | Accessibility | Corporate Policies | Product Security | Contact

Copyright © 2025, NVIDIA Corporation.