Jacob Coxon, a former pretraining researcher at OpenAI and Anthropic, has quit and accuses both companies of knowingly risking human extinction. Anthropic colleague Evan Hubinger puts the odds of a misaligned superintelligent AI wiping out humanity within the next decade at more than ten percent.

Jacob Coxon, a model pretraining researcher at Anthropic, announced his resignation on Tuesday, accusing the company and OpenAI, where he also worked, of “not acting responsibly”…

An Anthropic researcher has resigned from the company citing fears that AI labs are building systems that could kill human life in just a few years. | Trending