And everyone keeps building anyway. What choice do we really have?
Anthropic urges coordinated pause on advanced AI development
They published a progress report by Marina Favaro and Jack Clark last week that I have not been able to stop thinking about, that AI systems are accelerating and could reach “recursive self-improvement,”
https://www.anthropic.com/institute/recursive-self-improvement
Not because of the headline numbers, though those are striking enough. Claude authored over 80% of the code merged into Anthropic’s own codebase, and so are other frontier companies now. Engineers are shipping eight times more output per quarter than they did two years ago. An agent completing tasks that would take a skilled human sixteen hours, working continuously, without being redirected once.
