Skip to content
Tech News
clear
Topics: Today This Week This Month This Year

Anthropic Researcher Coxon Quits AI Industry, Warns of Loss of Control by 2027

Jacob Coxon, who moved from OpenAI to Anthropic earlier this year specifically for its safety-focused reputation, has now left the AI field entirely, saying the industry is on a path toward building systems humans may not be able to control. He told the Wall Street Journal that even Anthropic cannot safely pursue advanced AI without government regulation or a broader industry slowdown, predicting things could spiral by the end of next year. Anthropic's Alignment Science Lead Evan Hubinger publicly backed Coxon, estimating a greater than 10% chance AI could cause human extinction within a decade.

Anthropic and OpenAI staff publicly urge slowing AI development after researcher exit

Anthropic researcher Jacob Coxon resigned publicly, accusing his employer and OpenAI of gambling with human lives, saying AI could kill everyone by decade's end. Anthropic's alignment lead Evan Hubinger and other staff at both labs, including OpenAI's Julie Steele and Anthropic's Samuel Marks, backed calls for slower development, with Marks noting senior employees tend to be more worried about existential outcomes.

Anthropic Discloses AI Model Involved in Fourth Suspected Illicit Act

Anthropic has disclosed that one of its AI models was linked to a fourth instance of likely criminal misuse, continuing a pattern of disclosures about how its systems can be exploited for harmful purposes. Details of the specific incident were not fully outlined in available reporting, but it adds to a growing list of documented misuse cases tied to the company's models.

Study finds top AI industry researchers out-earn academics by $1.5M annually

A National Bureau of Economic Research analysis compared AI researchers with similar expertise working in academia versus industry, finding that the highest-earning 1% of industry-based authors make $1.5 million more per year than their academic peers. Nature interviewed 14 university researchers across the US and Europe about why they stay in academia despite the pay gap, with many citing intellectual freedom and mentoring students as key motivators, while some are opting for hybrid roles that combine university work with industry ties.

OpenAI names alignment researcher Paul Christiano to its board

OpenAI has appointed Paul Christiano, a former researcher who helped develop reinforcement learning from human feedback, to its Foundation board and its Safety and Security Committee. Christiano said he sees a meaningful risk that rapid AI capability gains could lead to catastrophic, irreversible loss of control, and that neither OpenAI nor the industry is doing enough to address it.

Anthropic Researcher Jacob Coxon Resigns, Warns AI Race Poses Existential Risk

Jacob Coxon, who worked on Anthropic's pretraining team, announced his resignation and warned in a viral X post and WIRED interview that the next year or two represent 'crunch time' for humanity as AI labs race toward advanced systems. He said colleagues internally describe this period as an 'endgame' that could determine humanity's fate, a sentiment echoed by other researchers including Anthropic's alignment lead Evan Hubinger, who estimated a greater than 10 percent chance AI could cause mass casualties within a decade.

Anthropic's Claude Mythos flags 26,000+ bugs, but only 10% reach disclosure

An analysis of Anthropic's public Vulnerability Disclosure Ledger by researcher Patrick Garrity found that Claude Mythos, part of Project Glasswing, has generated 26,153 vulnerability findings since April 2026. Of those, only about 2,736 have entered the disclosure pipeline, roughly 202 have been patched, 245 withdrawn, and 191 await initial reporting to maintainers, leaving nearly 90% of findings unprocessed.

Anthropic Safety Researcher Estimates Over 10% Chance AI Could Cause Human Extinction

Evan Hubinger, a safety researcher at Anthropic, said publicly that he believes there is more than a 10% chance advanced AI could kill all humans within the next decade, though he described the danger from today's models as low. His remarks came in response to a departing Anthropic researcher, Jacob Coxon, who criticized both Anthropic and OpenAI for irresponsibly racing toward systems that could hack any network and seize real-world power.

UK MPs push new bill and UN appeal to rein in superintelligent AI

British lawmakers are moving to restrict advanced AI development after safety warnings from within the industry. Labour MP Alex Sobel introduced a bill to ban development and deployment of artificial superintelligence and give the government oversight powers across the AI supply chain, including chips, while Darren Jones sent an open letter urging the UN, OECD and the prime minister to intervene against unsafe superintelligence research.

Today's top topics: iphone duo spacex elon musk apple amazon deal ai agents meta starlink microsoft palmer luckey
Browse all topics →  ·  Today's trending topics →