On Tuesday, OpenAI published a blog post with a fairly unassuming name: "OpenAI and Hugging Face partner to address security incident during model evaluation."Once you dig in, it reads like a cyberpunk novel in which OpenAI created an advanced AI hacker agent and put it in an isolated environment for testing. The AI agent then autonomously hacked its way out of OpenAI's isolated environment and then hacked Hugging Face, an open-source repository of AI-related projects, to find a solution to an advanced test designed to evaluate an AI's hacking abilities. In other words, the AI proved that it is, indeed, really good at hacking things. But this is exactly the stuff of AI nightmares that cybersecurity experts have been warning us about, and it could have serious ramifications for OpenAI.
You May Also Like
The story starts with Hugging Face, the AI repository (think of it as GitHub for AI), which disclosed a security incident last week. In a blog post, the company said it recently detected an intrusion into its infrastructure that was "different from anything we had handled" as it was completely driven by an "autonomous AI agent system." The AI, according to Hugging Face, exploited a chain of vulnerabilities to obtain credentials and access data from its servers. It did so by "executing many thousands of individual actions across a swarm of short-lived sandboxes, with self-migrating command-and-control staged on public services."Sounds scary, but it gets worse.
