New Delhi: Days after OpenAI launched a new model Astra, the company’s chief scientist, Jakub Pachocki has sounded a warning about the future of AI.
“This is a time that calls for extreme caution. I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence. OpenAI will continue to seek technical solutions to alignment and monitoring, to build defensive systems and unilaterally withhold further scaling as needed; however, I believe broader interventions are required,” Pachocki wrote in an essay published on 6 September.In the essay, titled “An Alien Mind”, he writes that autonomous AI models “are becoming superhuman in their ability to break in and out of computer systems”. According to him, this expands the risks associated with AI “tremendously” putting humans in a “narrow window” where we must “tighten security of critical systems”.
“The core challenge of automating AI research is not “getting there” – it is getting there in a way that keeps people a part of the continued improvement process, and leaves the future in humanity’s hands,” he wrote.
Also read: Two keys, one dilemma—the story of Modi’s slum neighbours evicted to new homes 50 km away
