Home
Storia in 1 fonti
I Fine-Tuned a 270M Model on My Laptop (Full Fine-Tuning, From Scratch)
Part 1 of a 4-part series. Full fine-tuning a tiny Gemma 3 model for intent classification — the generative framing, the loss-masking trick, and why full FT is so learning-rate sensitive.
Raccontata da
dev.to
Timeline cronologica
- ·
I Fine-Tuned a 270M Model on My Laptop (Full Fine-Tuning, From Scratch)
Part 1 of a 4-part series. Full fine-tuning a tiny Gemma 3 model for intent classification — the generative framing, the loss-masking trick, and why full FT is so learning-rate…
- ·
LoRA: I Trained <1% of a 1.5B Model and Matched a Full Fine-Tune
Part 2 of a 4-part series. How LoRA works (the low-rank trick), a working PEFT config, and three real GPU walls I hit — the FP16 unscale error, an OOM, and a 2-GPU speed mystery.
- ·
If a 270M Model Already Worked, Why Did I Fine-Tune a 7B One?
Part 4 (finale) of a 4-part series. Three model sizes tied on the same task — so when does bigger actually earn its keep? And the bug no model size could fix.