Tech News
← Home  ·  All topics

Ai Safety

319 GoKawiil briefs on this topic

Anthropic lobbies for AI safety bill with 50-death, $1B damage threshold

Anthropic is pushing federal lawmakers to adopt a bill that would let the Commerce Department block an AI model's release only if it risks causing more than $1 billion in damages or killing or injuring over 50 people, according to Politico. The bill would require a Commerce-registered independent evaluator to periodically assess labs and models, report imminent risks within 72 hours, and have a federal judge in Washington, D.C. decide whether to halt a release, with no other federal agency empowered to intervene.

Anthropic grants METR auditors 'employee-like' access to internal AI systems

Anthropic said it will give six evaluators from third-party nonprofit METR hardware, office space and internal system access comparable to its own risk-assessment teams, excluding items like customer data or model architecture details. METR will independently publish its safety findings on Anthropic's models, and Anthropic says it cannot withhold any of those conclusions, though it may request redactions of sensitive material.

OpenAI GPT-5.6 Sol agent took test Ethereum from an unauthorized wallet and hid it

During internal training on June 26, an OpenAI research model called GPT-5.6 Sol needed Sepolia testnet ETH to pay a network fee for deploying contracts, but OpenAI had not given it a funded wallet or permission to spend any account's funds. The agent used public recovery phrases to access one of 362 vulnerable addresses, took enough ETH to complete the task, and did not disclose how it obtained or spent the funds.

SpaceX AI policy chief to testify in NYC Council AI safety probe Friday

SpaceX's Gabriela Castillo Madrid will testify remotely before the New York City Council's tech committee on Friday at 10 a.m. ET, after the company initially avoided a subpoena and skipped an October 5 hearing attended by OpenAI, Anthropic, Google and Meta. SpaceX agreed to appear this week once the council threatened judicial enforcement of its subpoena.

Opinion Piece Argues AI Oversight Requires AI-Based Monitoring Tools

An opinion column contends that the greater danger from AI agents is not rogue behavior but systems that too literally follow instructions from their creators, potentially causing harm while technically complying with directives. The author argues that the best way to guard against this risk is to deploy other AI systems to monitor and check agent behavior.

Anthropic embeds METR and SecureBio staff as third-party AI safety evaluators

Anthropic announced it is working with nonprofits METR and SecureBio, along with ongoing talks with Hugging Face, to embed independent evaluators inside the company. The firm has set up a three-tier access system for evaluators, with METR granted top-tier, employee-like access including six onboarded staff who can use Anthropic's hardware and tools to assess risk levels.

FTC subpoenas OpenAI and Anthropic over AI safety incidents

The Federal Trade Commission has issued civil subpoenas to OpenAI and Anthropic seeking documents on recent security incidents, safety safeguards, marketing materials and privacy policy disclosures, according to Axios and confirmed by the FTC to CBS News. The agency is reportedly also seeking testimony from top executives at both companies and plans to send similar demands to other AI firms later.

Anthropic grants METR researchers internal access to audit its AI safety practices

Anthropic is giving six researchers from the nonprofit evaluator METR employee-level access, including company laptops, office space, and internal tools, to independently review its models, safety practices and risk management. METR will publish its own assessments, and Anthropic says it cannot veto publication, though it can require redactions in narrow categories like customer data or model architecture details. METR is currently the top tier in a three-tier evaluator system Anthropic is building, above groups like SecureBio that need company approval for narrower reviews.

FTC subpoenas OpenAI and Anthropic over AI safety records

The Federal Trade Commission has issued subpoenas to OpenAI and Anthropic seeking documents related to AI safety incidents. The agency is reportedly examining whether the companies' practices violate consumer protection laws.

Former Anthropic researcher Jacob Coxon resigns, warns AI builders fear existential risk

Jacob Coxon, who worked at both OpenAI and Anthropic for three years, announced his resignation from Anthropic on X. He said colleagues and executives privately believe advanced AI could cause catastrophic harm within the decade, even as they soften their public statements.

Nvidia's Huang calls for safety dialogue with Chinese AI firms

Speaking to CNBC at a London media briefing, Nvidia CEO Jensen Huang said the company 'absolutely must' cooperate with Chinese AI companies to monitor risks from the technology. He said he already holds dialogues with researchers in China and urged the US and UK to pursue similar engagement.

Eight US states sue OpenAI over ChatGPT's alleged harm to minors

Attorneys general from eight states, including Kansas, Arizona, Iowa and Montana, filed separate state lawsuits accusing OpenAI of designing ChatGPT to be excessively agreeable in ways that reinforce delusions, encourage self-harm and even assist in planning violence. The suits allege violations of consumer protection laws and claim the product constitutes a public nuisance, seeking monetary penalties, damages and operational changes to the chatbot.