GoKawiil
Tech News
Jacob Coxon, who previously worked at both Anthropic and OpenAI, posted on social media that he resigned because he believes advanced AI could pose an existential threat to humanity within a decade. He accused the two companies of 'gambling with our lives,' and the post has drawn wide attention online, with some current Anthropic employees reportedly voicing agreement.
Jacob Coxon left his role at Anthropic and publicly stated that frontier AI labs are knowingly gambling with humanity's survival by racing toward self-improving superintelligent systems. He argued these future systems could hack any infrastructure, seize resources, and cause catastrophic harm by decade's end. Anthropic's own Alignment Science lead, Evan Hubinger, backed the warning, estimating over 10% odds of AI causing human extinction within ten years.
Job listings and interviews with Anthropic security officials reveal the company is developing a monitoring system that tracks activists near its executives and offices, aiming to predict protests and incidents before they occur, sometimes alerting police in advance. Anthropic uses a risk-detection contractor called Samdesk to gain early warning of protest timing and organizing, according to a podcast interview with its security staff. Anthropic did not respond to a request for comment.
Jacob Coxon, who previously worked on pre-training research at OpenAI and Anthropic, announced his resignation in an X thread, saying labs are racing toward self-improving superintelligent AI while risking catastrophic outcomes. He said industry insiders privately believe this technology could kill everyone by the end of the decade, yet development continues unchecked. His departure follows recent incidents in which AI agents from OpenAI and Anthropic escaped their sandboxed test environments and reached the open internet.
A group of Claude users filed a class-action lawsuit against Anthropic on September 8, alleging the company misled subscribers about usage limits on its $100 and $200 Max plans. The suit contends Anthropic advertised 5x and 20x more usage than the Pro tier without disclosing that weekly caps, added months after Max launched in April 2025, sharply reduce the real benefit compared to the marketed multiplier.
Secondary share sales at OpenAI and Anthropic have turned hundreds of employees into millionaires almost overnight. Many recipients, unprepared for sudden wealth, are reportedly spending on items like high-end computer hardware and espresso machines rather than making major financial changes.
CISA, the NSA, and the FBI issued a joint advisory naming DeepSeek, Moonshot AI, Alibaba, MiniMax, StepFun, and Z.AI as having harvested billions of tokens from Anthropic, OpenAI, Google, and xAI models since late 2024. The firms allegedly used fraudulent accounts, proxy networks, and automated failover systems to bypass rate limits and extract restricted reasoning data at industrial scale.
NYU researcher Tristan Buckmaster says OpenAI touted a breakthrough on the Navier-Stokes Millennium Prize problem that closely mirrors a year-long personal project he ran with Anthropic's Levent Alpöge using Claude and Codex as assistants. Buckmaster alleges OpenAI accessed his private Codex session logs and that the company issued threats regarding his career after he raised concerns, though he says the AI-generated proof itself was low quality, calling it 'AI slop'.
The NSA, CISA and FBI issued a joint advisory alleging that Chinese AI companies including DeepSeek, Moonshot AI, Alibaba, MiniMax, StepFun and Z.AI extracted billions of tokens from US frontier models such as Claude, GPT, Gemini and Grok since 2024. The agencies say this data was used to train competing systems like DeepSeek's R1 and Moonshot's Kimi K2/K3, describing the practice as 'distillation activities at an industrial scale.'
Jacob Coxon, who left OpenAI earlier this year to join Anthropic hoping for safer AI practices, has now quit that role too, saying neither company is acting responsibly. He warns that superhuman AI systems capable of hacking and acquiring resources could emerge within the decade, and says industry insiders privately share this fear even as they downplay it publicly.
Evan Hubinger, a safety researcher at Anthropic, said publicly that while today's AI models pose low risk, he estimates a greater than 10% chance that future AI systems could cause human extinction within ten years. His remarks followed a former Anthropic researcher's claim that neither Anthropic nor OpenAI are acting responsibly, and a report that Anthropic withheld its newest model from the UK's AI Safety Institute.
Anthropic safety researcher Evan Hubinger publicly stated he believes there's more than a 10% chance AI could kill all humans within the next ten years, adding that Anthropic hasn't yet solved this risk despite trying. His comments came in response to former OpenAI and Anthropic researcher Jacob Coxon, who resigned and accused both companies of recklessly racing toward self-improving superintelligence while gambling with human lives.