Skip to navigation

Example Projects for Fine-Tuning Models

View as Markdown

These example projects demonstrate how to fine-tune various large language models (LLMs) and image generation models using NVIDIA AI Workbench. The following projects highlight:

  • Fine-tuning of popular open-source models including Llama 2, Llama 3, Mistral, Mixtral, and Phi-3.
  • Parameter-efficient fine-tuning techniques with NeMo Framework.
  • Customization of image generation models like SDXL.
  • Best practices for model adaptation and optimization.

These examples are ideal for AI developers and researchers looking to:

  • Adapt pre-trained models to specific use cases.
  • Implement efficient fine-tuning strategies.
  • Optimize model performance for specific tasks.
  • Leverage NVIDIA’s tools and frameworks for model customization.
Example Project on GitHubDescriptionClone and OpenSupport Forum
Llama 2 FinetuneAn example project to fine-tune Llama 2Open in AI WorkbenchSupport forum link
Llama 3 8b FinetuneAn example project to fine-tune a Llama 3 8B ModelOpen in AI WorkbenchSupport forum link
Mistral FinetuneAn example project to fine-tune a Mistral 7B modelOpen in AI WorkbenchSupport forum link
Mixtral 8x7b FinetuneAn example project to fine-tune a Mixtral 8x7B ModelOpen in AI WorkbenchSupport forum link
NeMo PtuningAn example project to p-tune LLMs with NeMo FrameworkOpen in AI WorkbenchSupport forum link
NeMo PunctuationAn example project to annotate text with NeMo FrameworkOpen in AI WorkbenchSupport forum link
Nemotron FinetuneAn example project to fine-tune a Nemotron-3 8B modelOpen in AI WorkbenchSupport forum link
Phi-3 Mini FinetuneAn example project to fine-tune a Phi-3 Mini ModelOpen in AI WorkbenchSupport forum link
SDXL CustomizationAn example project to customize an SDXL modelOpen in AI WorkbenchSupport forum link