Windows Fine Tuning Combined Streams
In this video, we'll walk through setting up a Windows machine with an Nvidia GPU to serve as a development-scale fine-tuning workstation. We'll cover everything from installing WSL and the necessary tools to creating a Python environment and running the fine-tuning process.
Description
LLM Fine-Tuning is one of the go-to techniques for making LLMs perform better in specific scenarios. In this post I'll show you how to prepare a local Windows-based machine with an Nvidia GPU to serve as a development-scale fine-tuning workstation.
This video is based on my blog post you can find here:
https://robkerr.ai/fine-tuning-llms-using-a-local-gpu-on-windows/
0:00 Intro
2:33 Install WSL
6:01 Install g++
6:30 Install Miniconda
8:02 Install VS Code
9:35 Create Python Environment
10:15 Install Unsloth Components
14:15 Create Training Notebook
15:20 Fine-tune the model
16:48 Save the Adapter
17:18 Summary