"What more evidence do we need, absent a significant real-world incident, that catastrophic risk from AI is a real and present danger to us all?" said one expert.

The blog post said the breakout was “an unprecedented cyber incident, involving state-of-the-art cyber capabilities” and that the company was reinforcing its safeguards.

“We had a significant security incident during evaluation of our models,” OpenAI CEO Sam Altman said in a statement on social media.

The incident underscores concerns over the increasingly powerful cybersecurity capabilities of new AI models