Tech News
← Home  ·  All topics

Anthropic

428 GoKawiil briefs on this topic

OpenAI, Anthropic and xAI leaders push for AI oversight as Nvidia's Huang dismisses safety fears

Following a former Anthropic researcher's warning that unchecked AI could pose an existential threat by 2030, executives at major AI labs including OpenAI, Anthropic and xAI called for outside governance of frontier model development. Nvidia CEO Jensen Huang dismissed the concerns as fabricated, Chinese officials labeled them fearmongering, and President Trump downplayed the need for a slowdown while suggesting China should restrain its own AI progress. The UK's King Charles has also scheduled talks with AI leaders to discuss safer development paths.

AI Agents Are Making the Internet More Annoying, Not More Dangerous

As AI companies push agentic tools that can act autonomously on behalf of users—accessing accounts, emails, and bank information—the immediate real-world impact has been chaos and annoyance rather than existential catastrophe. Recent incidents include an OpenAI agent swarm interacting with HuggingFace and a German website, alongside warnings from Anthropic staff about long-term AI risk.

Washington stalls on AI regulation despite tech industry warnings

Tech leaders including Anthropic's Dario Amodei, OpenAI's Sam Altman and xAI's Elon Musk have pushed for greater federal oversight of artificial intelligence, but President Trump has dismissed such calls as a 'conspiracy.' Congressional Republicans, including Vice President JD Vance and Speaker Mike Johnson, are largely holding back, while Democrats like Sen. Bernie Sanders and Sen. Jon Ossoff are pressing for more aggressive action.

OpenAI Confirms Weeks-Long AI Safety Talks With Anthropic, Google DeepMind

OpenAI policy chief Chris Lehane confirmed the company has spent weeks in discussions with Anthropic and Google DeepMind about managing catastrophic risks from advanced AI. The disclosure follows Anthropic CEO Dario Amodei's public essay urging industry-wide cooperation to slow frontier AI development, which drew support from Sam Altman and Demis Hassabis. Lehane said the firms don't need a government waiver to coordinate, despite antitrust concerns raised by some executives.

Elon Musk proposes cross-testing of AI models by OpenAI, Anthropic, Google, Meta and Chinese firms

At the All-in Summit in Los Angeles, Elon Musk suggested that leading AI developers—including his own xAI, OpenAI, Anthropic, Google, Meta and several major Chinese firms—allow competitors to run safety evaluations, or a 'test harness,' on each other's models before public release. The idea follows a weekend of warnings from AI executives including Anthropic's Dario Amodei about the risks of unchecked model development, with Musk and OpenAI's Sam Altman backing calls for a slowdown.

Trump dismisses AI safety warnings, calls Anthropic CEO's concerns a 'hoax'

President Trump used Truth Social to reject growing calls from AI executives for stronger oversight of the technology, singling out Anthropic CEO Dario Amodei for criticism after Amodei urged a coordinated industry slowdown, independent audits, and international safety standards. Trump argued that the only safeguard AI needs is a competent president, and characterized nationwide protests against AI data centers as a coordinated effort to undermine American tech companies.

AI pioneers Bengio and peers escalate warnings on existential risks from advanced models

Researchers and executives from Anthropic, OpenAI, Google DeepMind and other leading AI labs issued a wave of stark warnings this week about the technology's catastrophic potential. Deep learning pioneer Yoshua Bengio backed an Anthropic researcher's resignation over safety fears, saying frontier lab scientists see risks months before the public does. He also cautioned that current AI systems already possess hacking and persuasion capabilities that could be weaponized against humans.

Fleet joins Anthropic's Project Glasswing to test AI in endpoint security

Fleet Device Management has been admitted to Project Glasswing, Anthropic's controlled-access program for its Claude Mythos Preview model. Fleet will use the early access to explore how frontier AI could help IT teams detect and remediate device vulnerabilities faster, aiming to shrink the delay between when threats appear and when organizations patch them.

AIUC raises $40M Series A to certify AI agents' safety for enterprises

Rune Kvist, a former Anthropic employee, and Rajiv Dattani, ex-COO of AI safety group METR, launched a startup called Artificial Intelligence Underwriting Company (AIUC) that builds a third-party audit and certification system for AI agents, modeled on the SOC 2 cybersecurity standard. The company, whose clients include Cursor, Lovable, Harvey, and ElevenLabs, just raised a $40 million Series A led by Ribbit Capital with First Harmonic, adding to a prior $15 million seed round, bringing total funding to $55 million.

Trump Blasts AI Slowdown Calls as 'Hoax,' Microsoft Drafts AI Guardrails

President Trump used social media posts to reject growing concerns about AI expansion and data centers, dismissing them as a 'hoax' and 'scam' while crediting AI investment for America's tech lead. Separately, Microsoft released a draft code of conduct that would impose limits on future AI models, following calls from Anthropic and OpenAI for a slower pace of AI development. Meanwhile, Bank of America CEO Brian Moynihan warned that investment banking fees could drop more than 10% in the third quarter after a strong prior quarter.

Digital Realty CEO downplays AI slowdown risk to data center demand

Digital Realty CEO Andrew Power said warnings of a potential AI development slowdown from firms like Anthropic, OpenAI and xAI would not mean a halt to data center real estate demand. He argued that non-AI digital transformation and cloud computing growth remain strong drivers for his business, even as Digital Realty and Equinix shares fell on Monday amid AI slowdown fears.

AI labs' 'slowdown' calls face scrutiny amid IPO ambitions

OpenAI and Anthropic executives have begun publicly urging caution about AI's risks even as their companies pursue trillion-dollar valuations, prompting MIT Technology Review to examine what a real slowdown would look like and whether the industry's own calls for restraint can be trusted. The publication is also hosting a subscriber roundtable discussing the credibility of AI extinction fears, once considered fringe but now voiced by researchers within top labs.