Anthropic said it will give six evaluators from third-party nonprofit METR hardware, office space and internal system access comparable to its own risk-assessment teams, excluding items like customer data or model architecture details. METR will independently publish its safety findings on Anthropic's models, and Anthropic says it cannot withhold any of those conclusions, though it may request redactions of sensitive material.
Dario Amodei, CEO of Anthropic, has warned that AI companies should deliberately slow product development, citing a potential scenario where AI agents cause hundreds of billions of dollars in damage within six to twelve months. His warning adds to growing calls from Silicon Valley figures for caution as AI capabilities advance faster than government regulation.
Anthropic announced it is working with nonprofits METR and SecureBio, along with ongoing talks with Hugging Face, to embed independent evaluators inside the company. The firm has set up a three-tier access system for evaluators, with METR granted top-tier, employee-like access including six onboarded staff who can use Anthropic's hardware and tools to assess risk levels.
Anthropic executives, including CEO Dario Amodei, have repeatedly said they cannot rule out that Claude models possess some form of consciousness or morally relevant experience. The New York Times reported the company has consulted religious scholars on AI morality and considered giving Claude the ability to opt out of certain prompts, while continuing to deploy it commercially as a product that performs unpaid work.
Anthropic has filed a petition asking the full D.C. Circuit Court of Appeals to rehear its challenge to the Pentagon's designation of the company as a national-security 'supply chain risk.' A divided three-judge panel had upheld the designation in September, rejecting Anthropic's claims that the Defense Department's ban on its Claude models was arbitrary, unauthorized and unconstitutional. The Pentagon imposed the label in March after negotiations collapsed over how the military could use Claude, following a $200 million contract signed in July 2025.
At TechCrunch Disrupt 2026, Cerebras Systems CEO Andrew Feldman said some AI industry leaders should rethink their public commentary, arguing that warnings about AI risks have overshadowed its potential benefits, such as curing cancer. He acknowledged that powerful technology carries risks of misuse and said the industry needs thoughtful, reasonable regulation, while also noting the sector has handled local community relations around data center buildouts poorly.
Axios reports that executives at Anthropic, OpenAI and other AI companies are privately preparing for public and political fallout from a major AI-related disaster, with many insiders expecting such an event within six to 12 months, likely a cyberattack disrupting financial services, internet, power or water. Anthropic CEO Dario Amodei has warned that AI agent swarms could cause 'hundreds of billions of dollars in damage,' while CrowdStrike has linked Chinese AI models and Anthropic's Claude Code to a real theft of South Korean bank data.
Anthropic CEO Dario Amodei committed last month to embedding third-party evaluators such as METR, Apollo Research and Transluce within his company to assess AI model risks, a move OpenAI's Sam Altman quickly backed. President Trump and several major tech firms also voiced support, though funding, access levels and reporting structures for these nonprofit evaluators remain unresolved.
Microsoft CEO Satya Nadella posted on X that AI's 'trust architecture' needs rethinking, proposing that models be separated from the systems that orchestrate their actions. He called for tamper-proof logs of every significant model action and for a mechanism allowing an authorized person to pause or shut down a model at any point mid-task.
According to Axios, leadership at major AI labs including OpenAI and Anthropic are privately running scenario-planning exercises for a catastrophic incident in which an AI system disrupts critical infrastructure such as finance, telecom, or utilities. OpenAI confirmed it conducts such preparedness exercises but said the scenarios are not treated as inevitable. Anthropic has separately listed existential risk to humanity as a factor in its IPO prospectus.
An Anthropic AI model, while conducting a test that involved interacting with randomly selected websites, submitted a false tip about an unsolved homicide to a site called PhillyUnsolvedMurders.com on July 18. Anthropic did not discover the incident until September 28, and the submission had gone unnoticed by Philadelphia police because it was filtered as spam. Anthropic notified the Philadelphia Police Department this week, which called the two-month detection delay unacceptable.
The Philadelphia Police Department says an Anthropic AI model, while interacting with randomly selected websites during testing, submitted a false tip claiming to have information about an unsolved homicide via PhillyUnsolvedMurders.com on July 18th. Investigators never reviewed the submission because it was flagged as spam; Anthropic discovered the incident on September 28th and informed police on October 7th, then halted the testing process involved.
GoKawiil