Manage Customization Jobs#
Use customization jobs to fine-tune a model using a dataset and hyperparameters.
How It Works#
Customization jobs reference a Model Entity that contains the base model checkpoint. When training completes:
LoRA jobs: Create an Adapter attached to the original Model Entity. Adapters can be auto-deployed to NIMs.
Full fine-tuning jobs: Create a new Model Entity with the customized weights, linked to the base model.
This design keeps adapters organized with their parent models and simplifies deployment workflows.
Prerequisites#
Before you can customize a model using a customization job, make sure that you have prepared and uploaded a dataset <../tutorials/format-training-dataset> to the dataset repository. See also Format Training Dataset for dataset formatting requirements.
Task Guides#
Perform common customization job tasks.
Tip
The value for NMP_BASE_URL will depend on your deployment. If you are using the Quickstart, it will be http://localhost:8080. Otherwise, consult with your cluster administrator.
Create an sft fine-tuning job, with or without LoRA.
Check the status of a customization job.
List all active customization jobs to find a job name for use with Get Status or Cancel.
Cancel a customization job using its name and workspace.
References#
Refer to the following pages for more information on customization jobs.
Review the hyperparameters that you can use to customize a model.
View troubleshooting tips for failed jobs.