The Sequence Knowledge #898: The Trace Is the Teacher: Distilling Reasoning Into Small Models

From the release of DeepSeek R1, distillation in reasoning models have become one of the most common techniques in frontier AI.

Raccontata dathesequence.substack.com