Anthropic CEO Dario Amodei has warned that increasingly powerful AI systems cannot be safely entrusted to governments or corporations alone, arguing that both require meaningful checks and balances as artificial intelligence becomes more capable.
In an essay published Wednesday, Amodei also said governments should have the authority to block or reverse deployments of advanced AI models that pose unacceptable risks, including threats related to cybersecurity, biological weapons and loss of control of AI systems.
The Anthropic CEO argued that AI companies could eventually develop "quasi-state characteristics," becoming powerful enough to influence society in ways traditionally associated with governments.
He wrote that advanced AI may become "so powerful that it cannot safely be fully entrusted to either governments or companies." Why Transparency Is No Longer Enough Amodei said existing transparency-focused approaches to AI oversight are no longer sufficient as frontier models become increasingly capable.
He called for "more serious and binding regulation of AI" and compared advanced AI systems to airplanes and pharmaceuticals, arguing that they should undergo mandatory third-party testing before deployment.
