Washington (AP) — Two leading progressive lawmakers, Sen. Greg Casar, are unveiling legislation Wednesday that would ban artificial superintelligence and create a federal agency to oversee advanced AI as some of the industry’s own leaders urge Congress to impose guardrails on the advancing technology. The bill, provided first to The Associated Press, would also pause advanced AI development until guidelines are implemented while creating the Department of Artificial Intelligence.
Multiple employees at leading AI companies are endorsing the bill. “It doesn’t take a genius to say, ‘slow it down,’” Sanders, I-Vt., said in an interview with AP. “Do we really want to develop a super intelligence that when it becomes smarter than human beings could act independently of human control?
I don’t think we do.” Congress has so far done little to rein in the AI industry even as some of its most prominent leaders warn about potentially catastrophic risks. President Donald Trump has resisted recent calls for greater government oversight, putting him at odds with tech leaders including Anthropic’s Dario Amodei, OpenAI’s Sam Altman and xAI’s Elon Musk. The bill aims to dramatically slow down AI development The legislation would permanently prohibit artificial superintelligence, which it defines as a system that exceeds human cognitive ability or has sufficient capabilities to plan and execute the destruction or disempowerment of humanity.
It would temporarily pause development of the most advanced AI systems until new federal safety rules are established by a new Department of Artificial Intelligence. Advanced AI systems would then need federal approval before they could be deployed. Violations could carry significant penalties, including up to 20 years in prison in some cases.
A number of current employees at AI companies and experts signed on in support of the bill, according to a statement shared with AP. Juan Felipe Cerón Uribe, a researcher in OpenAI’s Safety Systems, said in a statement supporting the bill that “superintelligence could either go extremely right or extremely wrong” and that “we shouldn’t be playing such games.” Swante Scholz, a software engineer at Google DeepMind who said he was not speaking on behalf of his employer, said on the current path of development, the “most likely outcome is an existential catastrophe for humanity.” … Multiple employees at leading AI companies are endorsing the bill."It doesn’t take a genius to say, ‘slow it down,’” Sanders, I-Vt., said in an interview with AP.
Summary from source