Windows Fine Tuning Combined Streams
This video walks through the process of setting up a local Windows machine with an Nvidia GPU to fine-tune large language models (LLMs) for specific scenarios. Viewers will learn how to install necessary tools and components, create a Python environment, and fine-tune an LLM using a training notebook.
Description
LLM Fine-Tuning is one of the go-to techniques for making LLMs perform better in specific scenarios. In this post I'll show you how to prepare a local Windows-based machine with an Nvidia GPU to serve as a development-scale fine-tuning workstation.
This video is based on my blog post you can find here:
https://robkerr.ai/fine-tuning-llms-using-a-local-gpu-on-windows/
0:00 Intro
2:33 Install WSL
6:01 Install g++
6:30 Install Miniconda
8:02 Install VS Code
9:35 Create Python Environment
10:15 Install Unsloth Components
14:15 Create Training Notebook
15:20 Fine-tune the model
16:48 Save the Adapter
17:18 Summary