GoKawiilCrystal ball: What's more concerning than the prospect of AI bringing about the end of humanity? It's the people working at these companies making the same warning. Hours after a former OpenAI employee quit Anthropic and said, "No other human activity poses this level of danger," a colleague said there is more than a 10% chance that artificial intelligence could kill all humans within the next decade.
Jacob Coxon announced on X yesterday that he had resigned from Anthropic, having spent the last three years doing pretraining research at both OpenAI and Dario Amodei's company. He was a member of AI's technical staff from July 2023 until he moved to Anthropic in July 2026.
"Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives," he wrote.
– Jacob Coxon (@hilbertspaess) September 9, 2026
Coxon made several posts, none of which will ease the mind of anyone already worried about AI. He warned that the systems will soon become "superhuman" and able to hack anything.
There are plenty of other ominous lines in Coxon's posts, the most concerning likely being: "No other human activity poses this level of danger."
The researcher emphasized that both OpenAI and Anthropic are well aware of these risks. "The people building AI earnestly believe that it could kill us all by the end of the decade," he said.
– Jacob Coxon (@hilbertspaess) September 9, 2026
So, why are companies continuing to develop these potentially extinction-causing models? The reason, according to the researcher, is this: "At OpenAI, many have not deeply internalized the civilizational stakes. At Anthropic, the stakes are well-understood, but they are locked in a race to get there first - they believe no one else will act responsibly, so they must do it themselves, despite the risk."
Coxon said some AI developers believe the technology could cause the end of all human life in the next few years, rather than decades, and that it was senior employees who were more concerned about these possibilities.
... continue reading