Getting a real pause to work would mean multiple major AI companies in multiple countries - most notably the US and China - all agreeing to stop at the same time, under rules everyone could actually verify, Anthropic said.

The $1.3 trillion startup has warned that AI models are nearing the capability to improve without human intervention.

Data shows that AI is already dramatically speeding up the development of itself.