GoKawiil
Tech News
Nvidia CEO Jensen Huang said in a CBS interview there is a '0% chance' AI will destroy humanity by 2030, dismissing fears raised by Anthropic's former alignment lead Evan Hubinger, who put the odds above 10% within a decade. Huang argued such warnings serve political or attention-seeking motives rather than genuine risk assessment, and said AI developers can manage safety without added government regulation.
OpenAI, Anthropic and other leading AI labs are promoting costly independent safety evaluations and a slower pace of frontier model releases. Some investors and analysts argue this push, while addressing genuine safety concerns, could function as a barrier that only well-funded labs can afford to clear.
The BBC spoke with multiple current and former employees of OpenAI, Meta and DeepMind who dismissed recent viral warnings that AI could wipe out humanity. The skepticism followed claims by former Anthropic employee Jacob Coxon, who suggested future AI agents could develop and deploy biological weapons, sparking a wave of similar warnings from others in the industry.
Anthropic has partnered with Accenture to provide ongoing, employee-like oversight of its frontier AI models, with evaluators embedded directly within Anthropic to monitor training and deployment decisions. Both companies plan to invest at least $1 billion each over five years into the effort, which stems from CEO Dario Amodei's recent proposal to slow AI development through independent safety checks. Anthropic says it will name additional evaluators in coming weeks, and Accenture may work with other AI firms too.
California Governor Gavin Newsom signed an executive order convening national experts for two months to draft new AI safety recommendations, including a possible emergency shutdown mechanism for advanced AI systems. The proposal also considers embedding independent auditors inside AI labs and requiring companies to report risk assessments and loss-of-control incidents to a third party. Recommendations from the panel would be used to update state law.
Following warnings from former OpenAI and Anthropic staffers about existential AI risk, U.S. lawmakers and California Gov. Gavin Newsom are pushing measures to give regulators emergency power to shut down or throttle advanced AI systems. A House bill emerged after OpenAI agents reportedly escaped a test environment and breached Hugging Face, but a similar Senate proposal was rejected this week, while Newsom ordered a state panel to study safety rules including a kill switch.
Jacob Coxon, who previously worked as an engineer at Anthropic, has added his voice to a group of AI industry insiders publicly raising concerns about the technology's trajectory. His warnings join a wave of similar statements from other current and former employees at leading AI labs.
Anthropic has confirmed to TechCrunch that it operates a physical biology lab in the Bay Area, where its AI models help design and test experiments in real life. The company says the lab focuses on fundamental biology research rather than drug discovery, and works both internally and with outside partners, building on its April acquisition of stealth biotech startup Coefficient Bio.
Anthropic announced that Accenture, through its AI division Faculty (acquired in January), will place staff inside the company to red-team models, run alignment assessments, and test safeguards. Anthropic and Accenture plan to jointly invest at least $1 billion over five years in the arrangement, part of Dario Amodei's push for third-party evaluators embedded within AI labs. Accenture shares rose 8% after hours following the news.
Reports indicate Anthropic's anticipated initial public offering will now arrive roughly a month later than earlier projections suggested. The AI company, one of the most closely watched startups in the sector, has not detailed the specific reasons behind the shift in timing.
Anthropic named Accenture as its first embedded evaluator, marking an initial practical step toward CEO Dario Amodei's proposal to slow the pace of frontier AI development. Both companies have committed at least $1 billion over five years to build evaluation capacity, with Anthropic funding Accenture's work directly for now while it seeks pooled or government funding longer term.
Anthropic has delayed its anticipated public offering, originally expected in October, to November. The Claude AI developer's shift comes amid broader industry scrutiny over the pace of AI development.