iLLaDA, an eight-billion-parameter diffusion language model, demonstrates that generating text by refining a whole passage at once can match conventional left-to-right models at the same scale. The model, described in a paper on arXiv with weights and code released, improves broadly over its predecessor across general knowledge, math, and coding tasks and stays competitive with a strong, similarly sized conventional model — marking the first time the diffusion approach has held its ground at this scale.
Key facts
What: Almost every chatbot writes one word at a time, left to right. A newly released model of real size writes the way image AIs paint, refining a whole passage at once, and finally holds its own.
When: 2026-06-25
Primary source: read the source (arXiv 2606.25331)
