The Sequence Knowledge #890: A Brief History of Model Distillation

The papers and techniques that laid out the ground work to evolve distillation to this level.

Raccontata dathesequence.substack.com