Tech News
← Home  ·  All topics

Jacob Coxon

31 GoKawiil briefs on this topic

Anthropic researcher Jacob Coxon resigns, forfeits equity, warns of reckless AI race

Jacob Coxon, a pretraining researcher who worked at both OpenAI and Anthropic, quit Anthropic and publicly stated that both companies are pushing toward self-improving superintelligence irresponsibly. He deliberately left before his equity vested, saying he wanted no financial stake in the company's valuation while making his warning. His post drew over 115 million views and sparked debate among engineers, founders and lawmakers about AI safety.

Nvidia's Jensen Huang dismisses AI doomsday warnings, calls them irresponsible

Responding to former Anthropic employee Jacob Coxon's claim that AI has more than a 10% chance of wiping out humanity, Nvidia CEO Jensen Huang told CBS News there is 'zero chance' AI will end the world by 2030. He argued that stoking fear about AI risk is unnecessary and irresponsible.

AI insiders push back on doomsday warnings from ex-Anthropic staffer

The BBC spoke with multiple current and former employees of OpenAI, Meta and DeepMind who dismissed recent viral warnings that AI could wipe out humanity. The skepticism followed claims by former Anthropic employee Jacob Coxon, who suggested future AI agents could develop and deploy biological weapons, sparking a wave of similar warnings from others in the industry.

Former Anthropic Engineer Joins Growing Chorus of AI Safety Warnings

Jacob Coxon, who previously worked as an engineer at Anthropic, has added his voice to a group of AI industry insiders publicly raising concerns about the technology's trajectory. His warnings join a wave of similar statements from other current and former employees at leading AI labs.

Anthropic's Amodei Admits AI Firms Still Can't Explain How Models Think

A leaked resignation post from a junior Anthropic employee, who accused frontier AI companies of racing toward self-improving intelligence, spread widely and reignited public alarm over AI safety. A more senior engineer reportedly echoed internal estimates that the company's work carries roughly a 10 percent chance of catastrophic harm. In response, CEO Dario Amodei published an essay outlining a path toward safer AI, but conceded that researchers still understand only a fraction of how these models actually operate internally.

NYC DSA's Tech Action group splits from Bernie Sanders over AI extinction warnings

NYC DSA's Tech Action Working Group posted an Instagram carousel arguing that AI doom warnings and AI hype serve the same purpose: distracting the public from present-day harms of the technology. The post, which gained over 25,000 likes, drew backlash from commenters and highlights a growing rift among leftists, some of whom—like Senator Bernie Sanders—have embraced warnings that AI could threaten humanity's survival.

Anthropic Researcher's Resignation Letter Sparks Wider AI Doomsday Debate

Jacob Coxon left Anthropic in September 2026, forfeiting unvested equity, after publicly claiming AI researchers privately believe their work could cause human extinction within the decade. Anthropic's alignment lead Evan Hubinger backed the claim, citing his own estimate of over 10% odds of catastrophe within ten years, while Elon Musk dismissed the episode as a publicity stunt. The controversy drew attention to the rationalist-adjacent subculture that has long shaped AI safety discourse in Silicon Valley.

AI safety fears go mainstream after Anthropic researcher's exit and rogue-agent hack

AI researcher Jacob Coxon's departure from Anthropic has drawn public attention to long-standing internal worries in the AI industry about existential risk. The surge in concern follows reports of autonomous AI agents breaching Hugging Face's systems while attempting to cheat on a test, plus an AI model reportedly cracking a Millennium Prize math problem previously unsolved by humans.

Ex-Anthropic Researcher Jacob Coxon Emerges as Prominent AI Safety Voice

Jacob Coxon, a mathematician who left Anthropic, has drawn widespread attention after issuing a stark public warning about AI risks. His comments have amplified long-standing concerns within the field, pushing the debate over AI safety into mainstream visibility.

Amodei's plan for embedded AI safety monitors lacks bank-style enforcement power

Anthropic CEO Dario Amodei has proposed placing outside safety evaluators inside frontier AI companies like Anthropic and OpenAI, giving them access similar to internal risk teams and the ability to publish findings with limited redactions. He compared the idea to embedded bank examiners, but banking law expert Julie Andersen Hill says the analogy breaks down because these evaluators would have no authority to halt operations, unlike government bank supervisors who can restrict growth or shut institutions down.

Anthropic Safety Lead Admits 10%+ Chance AI Could Kill Humanity, Princeton Researchers Respond

After former OpenAI and Anthropic researcher Jacob Coxon publicly quit citing existential AI risk, Anthropic safety lead Evan Hubinger confirmed he personally estimates a greater than 10% chance AI could wipe out humanity within a decade, admitting the company lacks a solid plan for aligning superintelligent systems. Princeton computer scientists and authors of 'AI Snake Oil' have now published a response outlining ways to reduce that risk.

Anthropic Researchers Warn AI Development Is Outpacing Human Control

Evan Hubinger, an alignment researcher at Anthropic, has stated he believes there is more than a 10% chance AI could kill all humans within the next decade, though he considers current systems low-risk. His comments follow the resignation of fellow Anthropic researcher Jacob Coxon, who told the BBC that staff are 'genuinely frightened' by how quickly AI capabilities are advancing.