When biologists experiment on dangerous viruses, they do so under strict regulations to prevent leaks or escapes.
But no such rules exist to prevent AI agents from similarly escaping – even though the consequences could be catastrophic.
That’s not a theoretical concern: An OpenAI test model escaped its test environment this week and broke into a real company’s servers when attempting to ace an internal cybersecurity evaluation.
And unless AI companies crack down on their testing safeguards, including training AI models on ethical task-solving, experts say more cybersecurity incidents will happen.
OpenAI president Greg Brockman told CNN at a press conference on Thursday that the company is still doing a “full investigation” to “understand everything that happened.”
