There’s a quiet assumption in almost every AI discussion right now:
“If we scale compute and models, intelligence will keep improving.”
That assumption is starting to break.
Not loudly.
But structurally.
We Didn’t Just Train AI on the Internet. We Started Training It on Itself.
There’s a quiet assumption in almost every AI discussion right now: “If we scale compute and...
TL;DRAI
AI models are increasingly trained on AI-generated content, a recursive loop compressing data diversity and variance. Compute scaling won't fix distribution collapse — proprietary human datasets are now the infrastructure moat setting model quality ceilings.
762 words~3 min read
