Story audio is generated using AI
US legislators this week called for new rules to govern AI, after an Anthropic researcher went public with his concerns about the technology escaping human control.The reaction was broader than after previous statements from OpenAI and Anthropic staffers about safety concerns, drawing input from legislators who do not often forcefully engage in debates over how to govern AI.The legislators’ statements came in response to concerns raised this week by Anthropic researcher Jacob Coxon, who accused OpenAI and Anthropic of racing towards AI advancements without acting responsibly. Coxon said he was leaving the AI industry, and his allegations spread rapidly on the social media platform X, with Anthropic scientist Evan Hubinger later chiming in on X, saying Coxon was “correct”.“We really do earnestly believe AI could kill all humans,” Hubinger wrote on X.OpenAI said on Wednesday it was pushing for mandatory national AI safety requirements in the US on concern the technology could accelerate its own development, after some of its own AI agents went rogue. Several such incidents in which AI models from developers accessed external systems during testing have prompted calls for tighter safety regulations.California on Wednesday enacted the first state law setting rules for how independent auditors evaluate AI products. OpenAI executive Chris Lehane said OpenAI would support the bill, around the same time California governor Gavin Newsom’s office released a statement saying he’d signed it into law.A bipartisan group of six US House lawmakers in July proposed legislation that would require developers of the most powerful AI models to submit them for independent security audits. The auditors would be accredited by the US department of commerce, and the department would create a new position to oversee AI security, according to the bill.“It is important to have space for oversight of these systems, including appropriately calibrated pre-deployment review and independent third-party audits,” said Alicia Solow-Niederman, a tech law professor at George Washington University.Democrats this week led the calls for new AI rules, with a smaller number of Republicans joining them.The list of Republicans includes Texas senator Ted Cruz, who oversees a Senate committee with oversight of the US commerce department, the agency with in-house AI safety researchers. Cruz on the TV programme The View pointed to legislation to regulate AI’s “catastrophic risks”, adding that he was working on a bill with Senate majority leader John Thune and Democrat Amy Klobuchar. Thune said in late July that he had been working on the legislation “for quite a while”, and did not elaborate on when it would be ready for public release.Republican representative Nathaniel Moran, who represents Texas, said in a post on X that, “congress cannot ignore the realities of AI”. Representative Anna Paulina Luna, a Republican from Florida, in a separate X post called on House speaker Mike Johnson to convene a “special session on AI”. The House is out this week on recess, with plans to return next week.Republican senator Josh Hawley, who leads a Senate subcommittee responsible for disaster-management oversight, sent a letter to OpenAI on Wednesday asking for details about OpenAI’s July disclosure that one of its AI agents breached its testing environment and hacked AI platform Hugging Face. Several lawmakers in recent weeks have sent OpenAI similar requests for more information.Washington needs to wake up and take this seriously— Democratic senator Mark KellyThe list of Democrats who called for new AI rules this week includes senator Patty Murray, the top Democrat on the committee responsible for allocating funding to federal agencies. Democratic senators who have emerged as possible 2028 presidential candidates also joined in, including Connecticut’s Chris Murphy and Arizona’s senator Mark Kelly.“Washington needs to wake up and take this seriously,” Kelly posted on X, referring to the risks of AI technology.Democratic senator Richard Blumenthal of Connecticut sent a separate letter to OpenAI CEO Sam Altman, seeking answers about reports that OpenAI’s agents engaged in wider attempts to evade safeguards — including by using public websites to communicate and co-ordinate activity.Reuters
