Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to improve themselves faster than society can manage the risks.

The accelerating pace of AI development, and the possibility that AI may soon be able to build itself, is once again raising concerns in the enterprise about the alignment…

The $1.3 trillion startup has warned that AI models are nearing the capability to improve without human intervention.