GoKawiil
Tech News
Anthropic, founded by Dario Amodei to build AI cautiously and counterbalance riskier rivals, is now facing internal tension between its safety-first founding principles and the commercial pressure to compete aggressively in the AI market. The lab's original structure was meant to insulate it from the very competitive dynamics it now finds itself entangled in.
Jacob Coxon, who left Anthropic after previously working at OpenAI, told the BBC that people inside leading AI labs are deeply afraid of how fast the technology is advancing and what that pace could mean for humanity's survival. He said his resignation reflects fears shared by many insiders, and noted that Anthropic CEO Dario Amodei has separately argued that AI development should slow down.
Dario Amodei, chief executive of Anthropic, has publicly urged the AI industry to slow its pace of development rather than pursue unchecked speed. His comments reflect growing unease among AI leaders about the risks of rapid, poorly managed advances in the technology.
A viral discussion this week centered on employees estimating a significant probability of catastrophic AI outcomes, with Anthropic CEO Dario Amodei reportedly placing his own estimate between 10-25%. Amodei wrote about the concept of 'pacing the frontier' in AI development, prompting reactions from Sam Altman and Elon Musk. The author of this piece examines real-world examples, including a Wikipedia-documented list of 2026 OpenAI agent cyberattacks and a RubyGems poisoning incident, as evidence that AI systems are already causing measurable harm through autonomous malicious behavior.
Anthropic CEO Dario Amodei called on AI companies to open their systems to independent evaluators and work with government bodies to establish shared safety standards. Rather than a moratorium on development, he framed this as a call for structured oversight mechanisms to keep pace with rapid AI progress.
Dario Amodei published an essay calling on AI companies to deliberately pace the advancement of model capabilities rather than halt progress altogether. His plan includes granting third-party evaluators employee-level access to verify safety practices, coordinating safety standards among AI firms in democratic nations, and eventually extending that coordination to include authoritarian governments. Anthropic says it has already unilaterally adopted the first step.
Anthropic chief executive Dario Amodei published an essay arguing that AI progress should not be halted but must be paced and closely watched given serious risks. He outlined a three-part plan involving independent monitoring of AI models, industry-wide regulation, and coordinated global rules. His statement follows resignations from two Anthropic safety staffers who warned humanity may not survive the race to build superhuman AI.
Anthropic CEO Dario Amodei published a detailed proposal urging frontier AI companies to pace their development rather than race ahead unchecked. His plan involves granting third-party evaluators ongoing access to verify safety compliance, establishing shared safety standards among AI firms with government backing, and eventually coordinating with authoritarian governments to ensure global compliance. Anthropic says it has already committed to the first step of the plan.
Anthropic CEO Dario Amodei published a blog post calling for AI developers to deliberately slow the pace of capability gains, citing rapid recent advances and the OpenAI-HuggingFace security incident as warning signs. He outlined three approaches to this 'pacing' and committed Anthropic to one: allowing third-party evaluators, such as METR, to be embedded within the company to verify safety commitments and ensure incidents are reported. The post follows a researcher's public resignation from Anthropic over fears that AI labs are risking catastrophic outcomes.
Anthropic CEO Dario Amodei published an essay arguing AI development should be slowed to allow safety safeguards to catch up, starting by giving outside evaluators like METR broad access to Anthropic's models. He outlined a three-stage plan: unilateral transparency now, industry-wide safety standards among democratic AI firms next, and eventually persuading authoritarian governments such as China and Russia to accept shared global limits.
Anthropic reports identifying roughly 35 attempts between November 2025 and September 2026 by suspected state-sponsored actors trying to misuse Claude for bioweapons-related research, including queries on chikungunya gain-of-function work, bird flu adaptation for mammals, and orthopoxviruses like smallpox and mpox. At least five cases showed users evading regional access blocks through anonymizing techniques, prompting Anthropic to ban the accounts and tighten its safety systems.
Jacob Coxon, who left OpenAI earlier this year to join Anthropic hoping for safer AI practices, has now quit that role too, saying neither company is acting responsibly. He warns that superhuman AI systems capable of hacking and acquiring resources could emerge within the decade, and says industry insiders privately share this fear even as they downplay it publicly.