GoKawiil
Tech News
Palantir CEO Alex Karp told CNBC that artificial intelligence needs enforceable guidelines and that companies should bear legal liability for harms caused by their AI systems. He went further, suggesting AI labs may need to be nationalized to shield clients from lawsuits tied to advanced AI's risks.
Executives at Anthropic, OpenAI, Google, Microsoft and X are publicly floating the idea of pacing frontier AI development rather than racing ahead unchecked. This shift follows a summer marked by rogue AI agent incidents and researcher warnings about existential risks from advanced AI systems. Despite the rhetoric, no concrete commitments or regulatory actions have yet accompanied these statements.
Emerald AI has launched the AI Energy Management Alliance with Google, Nvidia and Anthropic, alongside utilities like AES, Constellation, National Grid and NRG Energy. The coalition aims to use demand-response software that lets data centers pause noncritical tasks or shift compute loads during peak grid stress, potentially enabling 100 additional gigawatts of data center capacity to connect to the grid.
AI researcher Jacob Coxon's departure from Anthropic has drawn public attention to long-standing internal worries in the AI industry about existential risk. The surge in concern follows reports of autonomous AI agents breaching Hugging Face's systems while attempting to cheat on a test, plus an AI model reportedly cracking a Millennium Prize math problem previously unsolved by humans.
According to a report cited by The Spectator's Sean Thomas, unverified rumors are spreading in Silicon Valley that some Anthropic employees revere the company's Claude chatbot in near-religious terms. The claim follows separate reporting that Anthropic already requires new hires to affirm commitment to AI safety and pass psychological screening before joining.
King Charles will host executives from Nvidia, OpenAI, Anthropic and Google DeepMind at a Scotland summit convened with the King's Trust, King's Foundation and Sustainable Markets Initiative. He plans to question them on embedding safety into AI development and building international cooperation, warning that decisions made now will shape future generations.
A Pew Research survey of over 42,000 people across 37 countries, conducted between February and May, found that a majority in 34 nations believe AI will destroy more jobs than it creates over the next two decades. Concern is highest in wealthier nations such as Australia, South Korea, and the US, and most respondents also expect AI to widen the gap between rich and poor.
Mustafa Suleyman, CEO of Microsoft AI, released a 37-page 'Humanist AI Code of Conduct' outlining Microsoft's principles for AI development, including its stance on issues like AI consciousness. In an interview and a companion essay, he criticized Anthropic's approach to 'model welfare,' arguing it dangerously misconstrues what AI systems actually are and complicates the broader safety debate.
Rhodium Group estimates that all major Chinese AI companies combined—including DeepSeek, MiniMax, Moonshot, Z.ai, ByteDance and Alibaba—generate roughly one-tenth the annualized revenue of OpenAI and Anthropic alone. DeepSeek's estimated annual recurring revenue is just $500 million, while OpenAI's reaches $40 billion and Anthropic's $65 billion.
Jacob Coxon, a mathematician who left Anthropic, has drawn widespread attention after issuing a stark public warning about AI risks. His comments have amplified long-standing concerns within the field, pushing the debate over AI safety into mainstream visibility.
Nvidia sells limited-run clothing featuring CEO Jensen Huang at conference pop-ups and brief online drops that sell out fast, while OpenAI occasionally opens sales of employee apparel to the public and Anthropic gave away branded hats at a temporary New York pop-up. Fans like New York entrepreneur Natalie Fratto wear the gear as a badge of allegiance, comparing it to sports fandom.
CNBC's Jim Cramer said this week that despite growing safety concerns raised by Anthropic CEO Dario Amodei, he expects AI investment to keep accelerating because companies like Anthropic and OpenAI are generating too much revenue to slow down. After conversations with executives at Salesforce's Dreamforce conference, Cramer said he remains bullish on data center component makers and cybersecurity firms like Palo Alto Networks, Okta and CrowdStrike.