In a long article on its website, titled "When AI builds itself", Anthropic said it would be good to have the option to slow or temporarily pause frontier AI development, citing safety risks and loss of control over the models as they self-improve.

The accelerating pace of AI development, and the possibility that AI may soon be able to build itself, is once again raising concerns in the enterprise about the alignment…

The $1.3 trillion startup has warned that AI models are nearing the capability to improve without human intervention.