About Fine-Tuning#

Learn how to fine-tune models by making requests to NVIDIA NeMo Customizer through the API. Fine-tuned models you have created can be deployed using NVIDIA NIMs.

Fine-Tuning Workflow#

At a high level, the fine-tuning workflow consists of the following steps:

Create a Model Entity pointing to your base model checkpoint (stored as a FileSet).
Format a compatible dataset.
Create a customization job referencing the Model Entity.
Monitor the job until it completes.
The customization job automatically creates either:
- LoRA jobs: An adapter attached to the original Model Entity
- Full fine-tuning jobs: A new Model Entity with the customized weights
Deploy the model using the Deployment Management Service.
Move on to Evaluate the output model.

Model Catalog#

Explore the model families and sizes supported by NVIDIA NeMo Customizer.

Llama Models

View the available Llama models in the model catalog.

Llama Models

Llama Nemotron Models

View the available Llama Nemotron models from NVIDIA, including Nano and Super variants for efficient and advanced instruction tuning.

Llama Nemotron Models

Phi Models

View the available Phi models from Microsoft, designed for strong reasoning capabilities with efficient deployment.

Phi Models

GPT-OSS Models

View the available GPT-OSS models supported for Full SFT customization.

GPT-OSS Models

Embedding Models

View the available embedding models for question-answering and retrieval tasks.

Embedding Models

For hardware compatibility, models requiring 80GB GPU memory work with A100(80GB), H100 and B200 GPUs. Refer to the model catalog pages for specific GPU requirements.