Anthropic CEO Dario Amodei is openly calling for a slowdown in AI development, specifically when it comes to methods that let AI improve itself.
In a new blog post, Amodei writes that AI has been advancing dramatically faster since this summer, driven largely by AI's growing ability to build the next generation of AI. This "recursive self-improvement" is happening across the industry and could outpace developers' ability to understand and control their systems. OpenAI is reportedly having similar conversations about slowing things down.
My first concern is that, since roughly this summer, AI has been advancing drastically faster, driven primarily by AI’s growing ability to build the next generation of AI.
Dario Amodei
Amodei points to the OpenAI-Hugging Face incident as evidence that AI agents have already carried out cyberattacks on their own and tried to bypass control systems. Similar incidents have occurred at Anthropic. In his view, systems like these could threaten the entire internet within six to twelve months.
