If you have watched an AI write, you know the ritual. Tokens appear left to right, one after another, like someone typing very fast. It feels like proof of intelligence. It is actually a constraint. Every mainstream language model, from GPT to Claude to the small model running on your laptop, is locked into a strictly sequential process: emit a token, condition on it, emit the next one. Never look ahead. Never go back.
That constraint is now being attacked from an unexpected direction. This week, two deep explanatory posts are circulating on Hacker News at the same time: a guide from the Kuleshov group at Cornell titled "How to Build a Diffusion Language Model," and Sander Dieleman's post on continuous diffusion language models. They land on top of a real product wave. Inception Labs' Mercury generates over 1,000 tokens per second per user on standard GPUs. NVIDIA's open-weight Nemotron Diffusion models report 2 to 8 times the throughput of comparable autoregressive models while retaining up to 99 percent of their quality. Google shipped Gemma Diffusion as an open-weights release.
One disclosure before we go further. I am a backend engineer who runs his own AI agent infrastructure, not an ML researcher. I have never trained a diffusion model. Everything below comes from reading the primary sources this week, and I will link them so you can check me. But I found that the core idea is surprisingly buildable once you see it, and the "which one should I care about" question has a concrete answer now. That is what this article is for.
