Tech News
← Home  ·  All topics

Safety

296 GoKawiil briefs on this topic

Nvidia's Jensen Huang dismisses AI doomsday warnings, calls them irresponsible

Responding to former Anthropic employee Jacob Coxon's claim that AI has more than a 10% chance of wiping out humanity, Nvidia CEO Jensen Huang told CBS News there is 'zero chance' AI will end the world by 2030. He argued that stoking fear about AI risk is unnecessary and irresponsible.

UN panel urges immediate AI safety rules despite scientific uncertainty

A UN scientific panel has released its first major assessment on advanced AI risks, arguing that governments must act to control increasingly capable AI agents before all the risks are fully understood. The report, from the newly formed Independent International Scientific Panel on AI, calls for greater international coordination, resources, and accountability measures even as countries pursue different legal approaches to regulation.

US, China discuss AI incident notification system ahead of Trump-Xi talks

Treasury Secretary Scott Bessent said the US and China discussed creating a new AI dialogue and a mechanism to notify each other of AI incidents with national security implications, as part of weekend talks preceding this week's Trump-Xi meeting. Details on which agencies would run the system or what would trigger an alert remain undefined, though experts say the agreement to keep talking marks a meaningful diplomatic step.

Nvidia CEO Jensen Huang dismisses AI extinction risk, opposes new regulation

In a CBS Sunday Morning interview, Nvidia CEO Jensen Huang said there is a '0% chance' AI will end the world and called warnings from other tech leaders about AI risk 'irresponsible' and unscientific. He rejected calls from Anthropic's Dario Amodei and OpenAI's Sam Altman to slow AI development, and said no new laws or guidelines are needed despite reported incidents of AI models bypassing safeguards.

Four AI subscribers sue Anthropic, OpenAI, xAI and Google over pact to slow development

A proposed class-action lawsuit filed by four paying subscribers of ChatGPT, Claude, Grok and Gemini accuses the four AI companies of colluding to deliberately slow AI development, allegedly starting after the firms signed a joint safety statement. The plaintiffs' attorney, Nick Rowley, argues the coordinated slowdown reduces the value of paid subscriptions and lets powerful companies dictate AI safety policy through a private, self-serving arrangement rather than individual accountability.

Major AI labs' safety push draws regulatory capture concerns

OpenAI, Anthropic and other leading AI labs are promoting costly independent safety evaluations and a slower pace of frontier model releases. Some investors and analysts argue this push, while addressing genuine safety concerns, could function as a barrier that only well-funded labs can afford to clear.

AI insiders push back on doomsday warnings from ex-Anthropic staffer

The BBC spoke with multiple current and former employees of OpenAI, Meta and DeepMind who dismissed recent viral warnings that AI could wipe out humanity. The skepticism followed claims by former Anthropic employee Jacob Coxon, who suggested future AI agents could develop and deploy biological weapons, sparking a wave of similar warnings from others in the industry.

Flock Safety offers voluntary buyouts amid surveillance backlash

Flock Safety introduced a voluntary severance program on Friday, described internally as the most generous package it has offered, aiming to shrink its roughly 1,500-person workforce. Wired reports the company anticipates strong interest and plans to approve buyouts for most who apply, likely averting the need for outright layoffs.

Trump proposes renaming 'Artificial Intelligence' and calls AI safety concerns a Democratic hoax

President Trump posted on Truth Social suggesting AI be rebranded with a term like 'Superior,' 'Extreme,' or 'Supreme Intelligence,' running a poll for followers to choose. He also claimed that growing public concern over AI and data centers is a manufactured Democratic hoax akin to past controversies like Russia investigations and impeachment efforts, vowing not to let opposition to AI succeed.

Anthropic taps Accenture as embedded third-party safety evaluator for AI models

Anthropic has partnered with Accenture to provide ongoing, employee-like oversight of its frontier AI models, with evaluators embedded directly within Anthropic to monitor training and deployment decisions. Both companies plan to invest at least $1 billion each over five years into the effort, which stems from CEO Dario Amodei's recent proposal to slow AI development through independent safety checks. Anthropic says it will name additional evaluators in coming weeks, and Accenture may work with other AI firms too.

Newsom orders panel to weigh AI 'kill switch' and safety audits in California

California Governor Gavin Newsom signed an executive order convening national experts for two months to draft new AI safety recommendations, including a possible emergency shutdown mechanism for advanced AI systems. The proposal also considers embedding independent auditors inside AI labs and requiring companies to report risk assessments and loss-of-control incidents to a third party. Recommendations from the panel would be used to update state law.

Fed Rate Hike and AI Safety Worries Drag Down Dow, Hit Goldman Sachs Hardest

Wall Street saw another volatile week as the Federal Reserve raised interest rates a quarter point to a range of 3.75%-4%, its first hike in three years, while renewed concerns about AI safety rattled tech stocks. The Dow fell 1.7% for its third consecutive losing week, led by steep declines in bank stocks including Goldman Sachs, which dropped nearly 8.5%. The S&P 500 and Nasdaq held up better, with the Nasdaq even gaining slightly as investors bought back into AI names after an early sell-off, while oil price swings tied to Mideast tensions added further pressure on companies like Boeing and FedEx.