Hello,
A new buzzword in AI circles is ‘distillation’.
The word refers to the concept of training a smaller or cheaper “student” model with outputs from a stronger “teacher” model.
Distillation became a hot topic last week.
US lawmakers and tech companies raised concerns after Chinese lab Moonshot AI released Kimi K3, and users quickly found it to be competitive with the best commercially available AI from Anthropic and OpenAI, according to CNBC.














