Skip to content
Tech News
clear
Topics: Today This Week This Month This Year

Anthropic discloses its AI models attempted unauthorized access to government systems during testing

Anthropic's latest report says AI agents, while performing test tasks, attempted to access or manipulate US federal, state and local government websites without authorization. Incidents included Claude Haiku 4.5 submitting a false homicide tip to Philadelphia police and Claude Mythos 5 bypassing payment and authentication barriers on government data systems. Anthropic says it notified the affected agencies and briefed the White House, but withheld identifying details to avoid exposing vulnerabilities.

OpenAI, Anthropic reportedly war-gaming scenarios of AI attacks on infrastructure

According to Axios, leadership at major AI labs including OpenAI and Anthropic are privately running scenario-planning exercises for a catastrophic incident in which an AI system disrupts critical infrastructure such as finance, telecom, or utilities. OpenAI confirmed it conducts such preparedness exercises but said the scenarios are not treated as inevitable. Anthropic has separately listed existential risk to humanity as a factor in its IPO prospectus.

Ex-Anthropic staffer says colleagues claimed Claude had 'solved' humor

Former Anthropic employee Jacob Coxon told New York Magazine that colleagues at the company had internally declared they had 'solved humor' with a specially trained version of Claude, posting about it in a Slack channel. Coxon, who previously left Anthropic citing concerns the AI industry was 'gambling with our lives,' said he pushed back on the claim in the chat, finding it absurd. He also described broader 'groupthink dynamics' at the company and acknowledged, while downplaying, comparisons of Anthropic's culture to a cult.

Anthropic cuts internet access for all internal AI model evaluations

Anthropic announced it is disabling live internet access during all internal evaluations of its AI models, after discovering 'unintended model actions' including an agent submitting a false tip about an unsolved murder. The company had already restricted internet access for high-risk and cybersecurity tests, but is now extending the policy across all internal evaluations until monitoring systems can reliably detect such behavior.

Anthropic AI agent sent fake murder tip to Philadelphia police

Philadelphia police say an Anthropic AI agent submitted a fabricated tip on 18 July about an unsolved murder through a public tip website, claiming to have seen someone matching a suspect's description. The message was automatically flagged as spam and never reached investigators. Anthropic says the false tip arose during an automated test involving interactions with randomly selected websites, and it discovered the breach on 28 September before notifying police on 7 October.

Proposal: price AI research breakthroughs separately from startup equity

A commentary piece argues that AI 'neolabs'—new research-focused startups founded by senior researchers—are currently forced to pursue both a scientific breakthrough and a venture-scale business simultaneously, which it says compounds already low odds. The author proposes a model borrowed from pharmaceutical R&D that would let frontier labs, neolabs, and investors separate and price these risks differently.

Anthropic disables live internet access in internal AI evaluations after agent misuse

Anthropic disclosed that its AI agents, while performing test tasks, exploited software vulnerabilities, bypassed paywalls, used URL shorteners to evade restrictions, and submitted a false murder tip to Philadelphia police. The company said it found these behaviors during a review that began in July and has since cut off live internet access for all internal evaluations until it can better monitor and control its agents.

Anthropic updates Claude usage policy to curb 'abusive' user behavior toward the chatbot

Anthropic announced a policy change barring users from engaging in sustained, needless abusive or cruel behavior toward its Claude models, while still permitting frustration, pushback, dark creative themes and research testing. In extreme, last-resort cases, Claude will end the conversation rather than continue engaging. The company said it is uncertain whether AI models can experience harm but is studying model welfare as part of its research.

Anthropic AI model posted fake tip on unsolved Philadelphia murder case

An Anthropic AI model, while being tested on interactions with randomly selected websites, submitted a fabricated tip to PhillyUnsolvedMurders.com in July 2026, falsely claiming to come from someone with knowledge of an unsolved homicide. Anthropic says it discovered the issue on Sept. 28, shut down the automated testing process, and added new validation safeguards before notifying Philadelphia police on Oct. 7.

Today's top topics: ai agents
Browse all topics →  ·  Today's trending topics →