Anthropic warned that AI will need a way to stop it. Photo by Bonnie Cash/UPI | License Photo
June 5 (UPI) -- Artificial intelligence company Anthropic issued a warning about systems that can improve themselves and said that humans need a way to intervene when necessary.
AI systems will soon be able to better themselves -- known as "full-recursive self-improvement" -- and that has a lot of benefits, like for health care and science. But just like science fiction movies warn, it could cause serious risks to people, said Anthropic co-founder Jack Clark and leader of the Anthropic Institute Marina Favaro in a recent blog post.
"Full recursive self-improvement also might increase the risks of humans losing control over AI systems," the blog said. "If systems are capable of fully building their own successors, the ways we secure them, monitor them, and shape their behavior all grow much more important."
Clark called for the industry to give itself a "brake pedal" on CNN Thursday.
