Ex-Anthropic researcher quits, cites over 10% risk AI could cause human extinction
Jacob Coxon, who worked on pretraining research at both OpenAI and Anthropic, announced his resignation and warned that neither company is behaving responsibly as they race toward self-improving superintelligent AI. He said staff at these firms privately believe AI could kill everyone within the decade, with Anthropic aware of the danger but pressing forward anyway out of fear of losing the race to competitors.
GoKawiil's interpretation of the reporting above, not reported fact.
When insiders at the very labs building frontier AI systems publicly voice extinction-level fears, it undercuts industry reassurances about safety and signals deep internal unease about the pace of development. Coxon's departure adds to a growing pattern of researchers leaving AI companies over ethical and safety concerns, intensifying pressure on regulators and the public to scrutinize how these firms weigh competitive advantage against catastrophic risk.
- Jacob Coxon resigned from Anthropic after roles at both OpenAI and Anthropic in pretraining research.
- He claims Anthropic understands existential AI risks but continues racing to build superintelligence first.
- Some insiders reportedly believe AI could cause human extinction within years, not decades.
Superintelligence" by Nick Bostrom — If researchers walking away from frontier labs over existential risk piques your curiosity, Bostrom's Superintelligence is the foundational text that framed this whole debate. It lays out the arguments about self-improving AI and control problems that people like Coxon are now invoking publicly. A solid read for anyone who wants to move past headlines and understand the actual reasoning.
See Superintelligence" by Nick Bostrom on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.Source: techspot.com — Rob Thubron, 2026-09-09
Published there as: “Anthropic researcher resigns, warns the AI race could end in human extinction”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.