An artificial intelligence researcher has resigned from Anthropic, warning that the rapid development of advanced AI could pose an unprecedented threat to humanity.
Jacob Coxon, who said he spent the past three years conducting pre-training research at OpenAI and Anthropic, announced his resignation on X on Wednesday, accusing both companies of racing towards self-improving superintelligence without sufficient safeguards.
“I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below,” he said.
He warned against underestimating the capabilities of increasingly advanced AI systems, saying they could soon surpass humans in important areas and acquire significant power and resources.
“Do not underestimate the power of this technology. These will soon be superhuman systems that can hack anything, revolutionise any field overnight, and acquire real power and resources. We have all witnessed the progress in each of these domains, and progress is not slowing,” he said.
