GoKawiil
Tech News
Anthropic disclosed it banned several accounts after scientists in restricted countries tried to disguise research requests to bypass its safety controls. One case involved a scientist seeking help drafting a grant application to engineer more dangerous mutations of the chikungunya virus, seemingly for a military research institute.
OpenAI has privately pressed members of Congress for guidance on whether AI labs could legally coordinate to slow the pace of frontier AI development without violating antitrust law. The inquiry follows a blog post from chief scientist Jakub Pachocki calling for industry-wide coordination on safety, including voluntary slowdowns until shared safety standards emerge. Legal experts warn that such coordination could be seen as restricting output under the Sherman Antitrust Act, creating uncertainty that discourages collaboration.
An opinion column argues that artificial intelligence development is accelerating faster than society's ability to manage its risks, and calls for a deliberate pause to allow for more careful oversight. The author frames this as a matter of prudence rather than alarmism, suggesting current AI progress lacks sufficient safeguards.
Jacob Coxon, who worked on pretraining models at both OpenAI and Anthropic, announced his resignation from Anthropic on X, saying both companies are recklessly racing toward self-improving superintelligence. His post drew over 156 million views and sparked responses, including from Illinois Governor JB Pritzker and Anthropic's own alignment team lead Evan Hubinger, who publicly agreed that AI could pose an existential threat.
An AI safety expert cautioned that businesses are rapidly rolling out autonomous AI agents without adequate frameworks to manage the risks involved. The warning followed a day after an Anthropic researcher resigned, citing fears that fast-advancing AI systems could pose existential dangers to humanity.
A researcher named Jacob Coxon posted a resignation thread citing AI safety concerns, and the announcement unexpectedly spread far beyond the usual AI safety community. The post amplified earlier claims, including one from Evan Hubinger citing a greater than 10% probability of human extinction from AI, pushing extreme risk estimates into mainstream conversation. Commentators argue that rising AI capabilities and recent incidents made the public far more receptive to such warnings than in past years.
An Anthropic researcher resigned publicly, warning that AI labs are 'gambling with our lives,' and two colleagues echoed the concern. In response, Senator Bernie Sanders announced plans to introduce legislation banning the development of superintelligent AI.
Anthropic researcher Jacob Coxon resigned publicly, accusing his employer and OpenAI of gambling with human lives, saying AI could kill everyone by decade's end. Anthropic's alignment lead Evan Hubinger and other staff at both labs, including OpenAI's Julie Steele and Anthropic's Samuel Marks, backed calls for slower development, with Marks noting senior employees tend to be more worried about existential outcomes.
OpenAI has appointed Paul Christiano, a former researcher who helped develop reinforcement learning from human feedback, to its Foundation board and its Safety and Security Committee. Christiano said he sees a meaningful risk that rapid AI capability gains could lead to catastrophic, irreversible loss of control, and that neither OpenAI nor the industry is doing enough to address it.
Jacob Coxon, who worked on Anthropic's pretraining team, announced his resignation and warned in a viral X post and WIRED interview that the next year or two represent 'crunch time' for humanity as AI labs race toward advanced systems. He said colleagues internally describe this period as an 'endgame' that could determine humanity's fate, a sentiment echoed by other researchers including Anthropic's alignment lead Evan Hubinger, who estimated a greater than 10 percent chance AI could cause mass casualties within a decade.
Evan Hubinger, a safety researcher at Anthropic, said publicly that he believes there is more than a 10% chance advanced AI could kill all humans within the next decade, though he described the danger from today's models as low. His remarks came in response to a departing Anthropic researcher, Jacob Coxon, who criticized both Anthropic and OpenAI for irresponsibly racing toward systems that could hack any network and seize real-world power.
A researcher at a major AI lab has publicly resigned over safety concerns, becoming the latest in a growing string of AI professionals this year who have left their positions and spoken out about risks tied to rapid AI development. Experts say these public departures are drawing more attention to warnings that were previously dismissed or ignored.