A Little LLM Fine-tuning Primer | @jaredthecoder clip

Full live stream: https://youtube.com/live/Scs-8BOrjYo

A little LLM fine-tuning primer i did during my BasedGPT stream.

💰Support the stream!
CashApp: https://cash.app/$jawerty210
Venmo: https://venmo.com/jawerty210
Buy Me a Coffee: https://www.buymeacoffee.com/bjGHFVW355

Join The Discord: https://discord.gg/dv4TSzsk27

My Podcast: https://www.youtube.com/@schemeology

My Socials:
Github: https://github.com/jawerty
Twitter: https://twitter.com/jawerty
LinkedIn: https://www.linkedin.com/in/jawerty/
Twitch: https://www.twitch.tv/jaredthecoder10x
Rumble: https://rumble.com/c/c-3572412

00:00 Introduction (Using QLora)
00:56 The Dataset
04:13 Training loop
04:55 Quantization / Floating Point
07:06 Lora
09:18 Hanging with chat