Nemotron

Nemotron is a Large Language Model (LLM) that can be integrated into a synthetic data generation pipeline to produce training data, assisting researchers and developers in building their own LLMs.

The following examples use NeMo Framework Launcher, which provides a user-friendly interface to build end-to-end workflows for model development. To get started please follow the Installation Steps, and start the NeMo Framework container ensuring the necessary launcher and any data folders are mounted.

All the config scripts that you’ll use in the examples are located in NeMo-Framework-Launcher/launcher_scripts

We provide playbooks to showcase NeMo features including PEFT, SFT, and deployment with PTQ:

• NeMo Framework PEFT with Llama2, Mixtral-8x7B and Nemotron 4 340B

• NeMo Framework SFT with Mixtral-8x7B and Nemotron 4 340B

• NeMo Framework Post-Training Quantization (PTQ) with Nemotron4 and Llama3

1. Clone the latest NeMo-Framework-Launcher:

            

            
git clone git@github.com:NVIDIA/NeMo-Framework-Launcher.git
        

2. Launch the docker container mounted with the above repository:

            

            
docker run --gpus all -it --rm --shm-size=4g -p 8000:8000 -v ${PWD}/NeMo-Framework-Launcher:NeMo-Framework-Launcher  nvcr.io/nvidia/nemo:version
        

• Nemotron
• Data Preparation
  
  • Run Data Preparation
    
    • Configuration the Dataset
• Training with Predefined Configurations
  
  • Run Training
    
    • Configuration
• Model Evaluation
  
  • Run Evaluation
    
    • Configuration Evaluation
  • Run Evaluation on PEFT Nemotron Models
    
    • Configuration Evaluation
• Parameter Efficient Fine-Tuning (PEFT)
  
  • Run PEFT Training with NeMo Framework Launcher
  • Run P-Tuning on a Common Cluster
  • Run P-Tuning on a Slurm Cluster
  • Run P-Tuning on Base Command Platform
• Supervised Fine-tuning (SFT)
  
  • Run SFT inside NeMo Container
    
    • Step 1: Start NeMo Container
    • Step 2: Run SFT
    • Step 3: Run evaluation
  • Run SFT with NeMo Launcher
    
    • Configuration