NewzNEW YORK (AP) — Artificial intelligence insiders warned New York City's leaders about the dangers of the emerging technology on Monday, calling for greater oversight as local governments move to respond to mounting concerns that the systems could endanger humanity.At a hearing of the New York City Council, recently departed employees of Anthropic, OpenAI and Google DeepMind described a reckless culture at the firms, saying the biggest tech companies are racing to create technology they do not understand how to control.“The companies run on a startup mindset: Move fast, break things, fix them later. That works for a photo sharing app. It does not work for building the most powerful technology ever built," said Jacob Coxon, a former engineer at Anthropic who has become a leading voice for regulation.State and city governments have been considering ways to regulate AI as the Trump administration has taken a passive approach and Congress has proven inactive.
President Donald Trump has dismissed AI fears as a “hoax” and signed an agreement late last month that spells out a series of voluntary steps for the companies to take and largely allows them to self-police.An industry call for a slowdown followed Coxon’s warningsCoxon was a little-known engineer at Anthropic until he announced his departure through a series of social media posts that caught global attention. He told the Council that AI could have tremendous upsides, but without transparency and safeguards, it's more likely that things will spiral out of control.“On the current path, I think it is more likely than not that humanity loses control to these AIs and it could end in human extinction,” Coxon said.Days after Coxon resigned and aired his fears of worst-case scenarios, top executives including Anthropic’s Dario Amodei, OpenAI’s Sam Altman, SpaceXAI’s Elon Musk said they agreed AI’s development needs to slow down. AI companies have detailed steps they have taken to prioritize safety, but a coordinated industry slowdown faces several obstacles.A panel of AI company staffers — representing tech giants OpenAI, Anthropic, Google and Meta — also testified at the hearing in Manhattan on Monday, telling officials that their systems are already improving people's daily lives and stressing that they are laser-focused on safety.Anthropic and OpenAI have said their advanced AI products need to be regulated, and…
None of these levels is remotely acceptable.
Summary from source