The people building the most powerful AI systems on the planet are increasingly worried that the people building the most powerful AI systems on the planet might get everyone killed. That’s the uncomfortable reality taking shape across the AI industry in 2026, as competition between major labs intensifies and trust between their leaders erodes.
The cracks are showing
In September 2026, Anthropic researcher Jacob Coxon resigned from his position, publicly citing the risks of self-improving superintelligence. Coxon didn’t mince words, estimating a greater than 10% chance of human extinction from AI development.
In July 2026, more than 1,300 employees from major AI laboratories signed an open letter urging the US government to implement rules that would slow the pace of AI development.
A June 2026 survey of 272 AI experts spanning 37 countries found that 75% of identified risk categories carried at least a 10% probability of leading to catastrophic harm. Competitive pressures ranked among the leading risk factors.
