Tech News
← Home  ·  All topics

Ai Safety

154 GoKawiil briefs on this topic

OpenAI, Anthropic and xAI leaders push for AI oversight as Nvidia's Huang dismisses safety fears

Following a former Anthropic researcher's warning that unchecked AI could pose an existential threat by 2030, executives at major AI labs including OpenAI, Anthropic and xAI called for outside governance of frontier model development. Nvidia CEO Jensen Huang dismissed the concerns as fabricated, Chinese officials labeled them fearmongering, and President Trump downplayed the need for a slowdown while suggesting China should restrain its own AI progress. The UK's King Charles has also scheduled talks with AI leaders to discuss safer development paths.

OpenAI Confirms Weeks-Long AI Safety Talks With Anthropic, Google DeepMind

OpenAI policy chief Chris Lehane confirmed the company has spent weeks in discussions with Anthropic and Google DeepMind about managing catastrophic risks from advanced AI. The disclosure follows Anthropic CEO Dario Amodei's public essay urging industry-wide cooperation to slow frontier AI development, which drew support from Sam Altman and Demis Hassabis. Lehane said the firms don't need a government waiver to coordinate, despite antitrust concerns raised by some executives.

AI pioneers Bengio and peers escalate warnings on existential risks from advanced models

Researchers and executives from Anthropic, OpenAI, Google DeepMind and other leading AI labs issued a wave of stark warnings this week about the technology's catastrophic potential. Deep learning pioneer Yoshua Bengio backed an Anthropic researcher's resignation over safety fears, saying frontier lab scientists see risks months before the public does. He also cautioned that current AI systems already possess hacking and persuasion capabilities that could be weaponized against humans.

Trump dismisses AI safety concerns as 'hoax', opposes new regulations

President Trump used social media posts to reject growing concerns from AI industry figures about the technology's risks, comparing the safety debate to what he called the 'Global Warming Scam' and 'RUSSIA, RUSSIA, RUSSIA HOAX'. His comments came shortly after Anthropic co-founder Jack Clark told the BBC that a mandatory 'kill switch' verified by outside parties might be necessary for dangerous AI systems, part of a wave of warnings from AI executives that had already triggered a tech stock selloff.

Jensen Huang Answers Trump's Call on Samsung Galaxy Fold 8 at All-In Conference

At the All-In conference in Los Angeles, Nvidia CEO Jensen Huang took a live on-stage phone call from President Trump using a Samsung Galaxy Fold 8, not an Apple device as initially reported. During the call, the two discussed AI safety, with Trump dismissing fears about AI risks as a 'hoax' benefiting China and political opponents, and Huang appearing to agree that the technology's momentum shouldn't be slowed.

CrowdStrike CEO Says Existing AI Models Already Pose Security Risks Regardless of Slower Development

CrowdStrike CEO George Kurtz said on CNBC that slowing frontier AI development, as Anthropic's Dario Amodei suggested, won't remove security threats because dangerous models—both frontier and open-weight—are already deployed. His comments came as cybersecurity stocks rallied Monday, with CrowdStrike up nearly 14% to a record high and Palo Alto Networks up over 13%.

OpenAI, Anthropic, DeepMind and Musk float voluntary 'pace the frontier' AI safety pact

Executives from OpenAI, Anthropic, Google DeepMind and SpaceX loosely agreed over the weekend to slow AI development, backing a three-step proposal from Anthropic's Dario Amodei that calls for third-party auditors, domestic lab oversight and a global slowdown agreement. Critics argue the move looks less like genuine safety policy and more like an attempt by dominant firms to block competitors and open-source rivals while sidestepping binding legal rules.

Anthropic's Amodei and OpenAI's Altman call for coordinated 'pacing' of AI development

Anthropic CEO Dario Amodei published an essay proposing that frontier AI companies adopt independent evaluators, coordinate on safety standards with peer firms in democratic countries, and eventually seek global coordination including authoritarian governments, while stressing this does not mean halting AI progress. OpenAI's Sam Altman quickly echoed the sentiment, agreeing on the need to 'pace the frontier,' endorsing third-party evaluators, and calling for a federal framework establishing consistent safety requirements across the industry.

Anthropic touts adjusted operating profit while still losing billions overall

Anthropic reportedly told select investors that its adjusted operating income will be positive for a second straight quarter, according to the Financial Times. That metric excludes major recurring costs like R&D and compute, so the company still posts a substantial net loss on its actual bottom line.

Saudi Arabia shuts key East-West oil pipeline after drone strike, sending crude prices up 3%

Saudi Arabia closed its East-West pipeline, which can carry 7 million barrels of oil per day and bypasses the Strait of Hormuz, after saying it was damaged by drones launched from Iraq. The closure pushed both U.S. West Texas Intermediate and Brent crude futures up more than 3%, and prompted the postponement of a planned diplomatic meeting between Iran and Gulf Arab states on Hormuz security. The disruption comes as U.S. crude prices had already topped $100 a barrel last week amid escalating Middle East fighting.

Altman backs call for AI safety framework, warns of losing control to models

Sam Altman publicly detailed how AI safety rules could be structured, joining Anthropic's Dario Amodei and Elon Musk in urging the industry to slow its pace of advanced model development. He identified two failure scenarios: AI progress spiraling beyond human control, and power over the technology concentrating in too few hands. The comments follow a wave of employee warnings at OpenAI and Anthropic about catastrophic risks tied to self-improving AI systems.

Microsoft publishes 37-page AI code of conduct rejecting model consciousness claims

Microsoft released a 37-page 'humanist AI code of conduct' asserting that people matter more than AI and that AI models should not be designed to imitate consciousness. The document explicitly rejects granting AI legal personhood, welfare status, or rights, positioning Microsoft against ideas Anthropic has been exploring about model sentience.