Fine-Tuning Tutorials#

Use the tutorials in this section to gain a deeper understanding of how the NVIDIA NeMo Customizer microservice enables fine-tuning tasks.

Tip

Tutorials are organized by complexity and typically build on one another.

Dataset Preparation#

Format Training Datasets

Learn how to format datasets for different model types.

datasets chat-models completion-models

Start a LoRA Customization Job

Learn how to start a LoRA customization job using a custom dataset.

nemo-customizer

Start a Full SFT Customization Job

Learn how to start a SFT customization job using a custom dataset.

nemo-customizer

Start a DPO Customization Job

Learn how to start a DPO (Direct Preference Optimization) customization job using preference data.

nemo-customizer dpo

Start a Knowledge Distillation Job

Learn how to start a Knowledge Distillation (KD) job using a teacher and student model.

nemo-customizer distillation

Import and Fine-Tune Private Hugging Face Models

Learn how to import a private Hugging Face model and fine-tune it.

huggingface nemo-customizer

Check Customization Job Metrics

Learn how to check job metrics using MLflow or Weights & Biases.

nemo-customizer mlflow wandb

Optimize Tokens per GPU

Learn how to optimize the token-per-GPU throughput for a LoRA optimization job.

nemo-customizer wandb sequence-packing