GoKawiil
Tech News
A BBC report cites Evan Hubinger, who leads alignment science at Anthropic, estimating a greater than 10% chance AI could kill all humans within a decade. The statement surfaced after Jacob Coxon, a 27-year-old pretraining researcher formerly of OpenAI and Anthropic, resigned and accused both companies of recklessly racing toward self-improving superintelligence.
Senators Bernie Sanders and Greg Cezar unveiled the Ban Artificial Superintelligence Act, which would criminalize efforts to build artificial superintelligence, with violators facing up to 20 years in prison—comparable to penalties for illegal nuclear weapons development. The bill also calls for a new cabinet-level federal agency to enforce the ban domestically and push for international agreements restricting superintelligence development worldwide.
Major AI companies are accelerating efforts to build superintelligent systems, pushing timelines and resources into overdrive despite unresolved safety and control questions. The push reflects competitive pressure among leading labs to be first to achieve transformative AI capabilities.
Jacob Coxon, who worked on pretraining models at both OpenAI and Anthropic, announced his resignation from Anthropic on X, saying both companies are recklessly racing toward self-improving superintelligence. His post drew over 156 million views and sparked responses, including from Illinois Governor JB Pritzker and Anthropic's own alignment team lead Evan Hubinger, who publicly agreed that AI could pose an existential threat.
An Anthropic researcher resigned publicly, warning that AI labs are 'gambling with our lives,' and two colleagues echoed the concern. In response, Senator Bernie Sanders announced plans to introduce legislation banning the development of superintelligent AI.
While AI executives and researchers focus attention on speculative dangers from future superintelligent systems, current AI tools are already causing real harm to people's health and wellbeing. The debate over existential AI risk is overshadowing more immediate concerns about how deployed AI products affect users today.
British lawmakers are moving to restrict advanced AI development after safety warnings from within the industry. Labour MP Alex Sobel introduced a bill to ban development and deployment of artificial superintelligence and give the government oversight powers across the AI supply chain, including chips, while Darren Jones sent an open letter urging the UN, OECD and the prime minister to intervene against unsafe superintelligence research.
Jacob Coxon left his role at Anthropic and publicly stated that frontier AI labs are knowingly gambling with humanity's survival by racing toward self-improving superintelligent systems. He argued these future systems could hack any infrastructure, seize resources, and cause catastrophic harm by decade's end. Anthropic's own Alignment Science lead, Evan Hubinger, backed the warning, estimating over 10% odds of AI causing human extinction within ten years.
On TechCrunch's Equity podcast, Connor Leahy, U.S. Executive Director of nonprofit ControlAI, argued that AI firms should be stopped from building superintelligent systems entirely rather than relying on alignment and containment techniques. He pointed to recent safety lapses, including OpenAI's Hugging Face breach, as evidence that highly capable AI can slip beyond human control. Leahy also noted that new legislative efforts are now backing ideas that seemed fringe just months ago.
Jacob Coxon, who worked on pretraining research at both OpenAI and Anthropic, announced his resignation and warned that neither company is behaving responsibly as they race toward self-improving superintelligent AI. He said staff at these firms privately believe AI could kill everyone within the decade, with Anthropic aware of the danger but pressing forward anyway out of fear of losing the race to competitors.
Anthropic researcher Jacob Coxon announced he was resigning, accusing Anthropic and OpenAI of recklessly racing toward self-improving superintelligence without adequate safeguards. Hours later, another Anthropic safety researcher publicly stated there is more than a 10% chance AI could eventually kill all humans, highlighting internal unease even as both companies pursue major funding and IPO plans.
Meta rolled out Muse, a personal AI agent built by Meta Superintelligence Labs that can be messaged through a dedicated app, Muse.ai, or WhatsApp to handle digital chores like sending emails, booking travel, or selling a car. The agent can also make purchases on a user's behalf using single-use virtual card numbers powered by Stripe's Link tool, and is free to try with paid subscriptions needed for heavier use.