"We believe it would be good for the world to have the option to slow or temporarily pause," two leading Anthropic officials wrote.

The $1.3 trillion startup has warned that AI models are nearing the capability to improve without human intervention.

Data shows that AI is already dramatically speeding up the development of itself.