Self-building AI would be a technological milestone that would bring benefits in many areas, Anthropic said, but it “also might increase the risks of humans losing control over AI systems.”

Unilateral slowdowns could backfire if less cautious actors continue advancing, potentially reducing overall safety, it warns

Anthropic co-founder Jack Clark said AI agents might soon be able to build and train models themselves and, if that happens, humans could lose control over AI systems.