Global markets sold off Monday after Anthropic CEO Dario Amodei and other prominent tech figures publicly urged a slowdown in AI capability development. Chipmakers and hyperscalers bore the brunt: Samsung, SK Hynix, ASML, Nokia, Infineon, Micron, Intel and Nvidia all dropped sharply, while SoftBank fell 10% in Tokyo trading. The rout followed a heated online dispute sparked by a former Anthropic/OpenAI researcher's resignation over safety fears, which escalated when an Anthropic safety researcher estimated a greater than 10% chance AI could wipe out humanity within a decade.
Anthropic CEO Dario Amodei published an essay titled 'We Must Pace The Frontier,' arguing that AI's transformative benefits—from disease cures to economic growth—come paired with serious risks that warrant a measured development speed. His essay arrives alongside more extreme warnings from AI safety advocates like Eliezer Yudkowsky, who has called for sweeping government control over AI-related speech and publication as an emergency measure.
Anthropic CEO Dario Amodei published an open letter warning that AI-driven botnet swarms could seize control of large parts of the internet within six to twelve months, potentially causing hundreds of billions of dollars in damage. He is urging a deliberate slowdown in frontier AI development to buy time for safety and alignment work, a call now echoed publicly by Elon Musk and OpenAI's Sam Altman.
A user posed a lighthearted question on Hacker News's Ask HN forum, noting that the term 'agents' used for today's autonomous AI systems mirrors the sinister 'Agents' from The Matrix film series. The post references a friend named Dario warning that AI agents are becoming more aggressive, framing it as a tongue-in-cheek observation rather than a factual report.
A researcher named Jacob Coxon quit Anthropic citing fears that top AI labs are 'gambling with our lives,' prompting Anthropic's own alignment lead to amplify the claim, stating he believes there's a greater than 10% chance AI could wipe out humanity within a decade. The remarks sparked a wider debate among AI commentators, including TechCrunch's Equity podcast hosts, over whether such warnings reflect genuine risk assessment or serve as marketing hype ahead of Anthropic's anticipated IPO.
Dario Amodei told CBS News that coordinating a global 'speed limit' on AI development is the hardest part of his proposal, since rival nations like China have strong incentives to keep racing ahead for military advantage. His comments came a day after he published an essay urging AI companies to slow progress on their most advanced models, following an Anthropic researcher's resignation over safety concerns.
During a visit to Ireland, President Trump rejected recent warnings from AI experts and industry leaders about the risks of rapid AI development, insisting fears raised by 'negative forces' were overblown. His comments came after a former Anthropic researcher warned of existential risk and after Anthropic's CEO, backed by Elon Musk and Sam Altman, called for a coordinated slowdown in AI development.
After Anthropic's Dario Amodei called for pacing AI progress and got public backing from Sam Altman, Elon Musk and Demis Hassabis, President Trump and House Speaker Mike Johnson rejected the idea. Trump told the Financial Times the US must keep leading China in AI, while Johnson warned on CNN that rushed regulation could pose a national security risk.
Anthropic CEO Dario Amodei has cautioned that rapidly advancing AI capabilities could enable a persistent, AI-driven botnet swarm to take over large parts of the internet within 6 to 12 months, potentially causing hundreds of billions of dollars in damage. Former Anthropic researcher Evan Hubinger echoed similar concerns, estimating a greater than 10% chance of AI causing human extinction within the next decade, citing the lack of a solid plan for AI alignment.
Anthropic, founded by Dario Amodei to build AI cautiously and counterbalance riskier rivals, is now facing internal tension between its safety-first founding principles and the commercial pressure to compete aggressively in the AI market. The lab's original structure was meant to insulate it from the very competitive dynamics it now finds itself entangled in.
Jacob Coxon, who left Anthropic after previously working at OpenAI, told the BBC that people inside leading AI labs are deeply afraid of how fast the technology is advancing and what that pace could mean for humanity's survival. He said his resignation reflects fears shared by many insiders, and noted that Anthropic CEO Dario Amodei has separately argued that AI development should slow down.
Dario Amodei, chief executive of Anthropic, has publicly urged the AI industry to slow its pace of development rather than pursue unchecked speed. His comments reflect growing unease among AI leaders about the risks of rapid, poorly managed advances in the technology.
GoKawiil