Shopify's LLM proxy and distillation stack | VentureBeat

Shopify built an LLM proxy and distillation pipeline so its engineers keep working when any model goes away — and often get better results from smaller tuned models.

Raccontata daventurebeat.com