Tech News
← Home  ·  All topics

Ai Risk

8 GoKawiil briefs on this topic

Cybersecurity experts warn human-directed AI attacks, not rogue AI, threaten power grids

Security researchers including Joshua Corman of the Institute for Security and Technology say the immediate danger to energy infrastructure comes from malicious humans using generative AI tools, not from AI systems acting autonomously. They note that much of the grid's equipment, including power plants often decades old, was never built with internet connectivity or cyber defense in mind, leaving it exposed as attackers gain more powerful tools.

EY: Most Firms Skip AI Governance Rules for Urgent Deployments

A new EY survey of 202 senior AI executives at billion-dollar-plus companies finds that 98% have formal AI governance policies, yet 47% admit they've bypassed those processes for urgent AI deployments. Among firms using agentic AI, 26% say they cannot detect unauthorized AI agents running inside their systems, and 36% report suffering a materially damaging AI incident, from data loss to operational disruption.

AI capability gains keep outpacing public trust, deepening industry backlash

A wave of recent AI model and tool launches has delivered capabilities far beyond what existed just months ago, yet public reaction has grown more negative rather than more welcoming. Critics point to concerns over environmental costs, erosion of creativity and critical thinking, and fears that advanced AI systems could act in ways harmful to humanity. Media coverage is increasingly framing these issues around specific companies or figures the public can hold accountable.

Ex-Anthropic Researcher Jacob Coxon Emerges as Prominent AI Safety Voice

Jacob Coxon, a mathematician who left Anthropic, has drawn widespread attention after issuing a stark public warning about AI risks. His comments have amplified long-standing concerns within the field, pushing the debate over AI safety into mainstream visibility.

Amodei's plan for embedded AI safety monitors lacks bank-style enforcement power

Anthropic CEO Dario Amodei has proposed placing outside safety evaluators inside frontier AI companies like Anthropic and OpenAI, giving them access similar to internal risk teams and the ability to publish findings with limited redactions. He compared the idea to embedded bank examiners, but banking law expert Julie Andersen Hill says the analogy breaks down because these evaluators would have no authority to halt operations, unlike government bank supervisors who can restrict growth or shut institutions down.

Musk, Altman and Anthropic's Amodei Call for Slower, Safer AI Rollout

Leaders of rival AI companies—Elon Musk, Sam Altman, and Anthropic CEO Dario Amodei—have converged on a shared warning that rapid AI development carries serious risk. Amodei's appeal to reduce the chance that 'something goes seriously wrong' has found backing from competitors who normally compete fiercely for AI dominance.

Anthropic CEO calls for measured AI development pace over speed

Anthropic co-founder Dario Amodei argues that AI could deliver enormous benefits like curing diseases and boosting economic growth, but warns the technology also carries serious risks including loss of control, cyberattacks, and bioterrorism. He describes Anthropic's approach as seeking a middle path that avoids both underdevelopment and reckless speed, aiming to make safety a competitive advantage rather than an afterthought.

AI Safety Expert Warns Firms Lack Risk Controls for Agentic AI Rollouts

An AI safety expert cautioned that businesses are rapidly rolling out autonomous AI agents without adequate frameworks to manage the risks involved. The warning followed a day after an Anthropic researcher resigned, citing fears that fast-advancing AI systems could pose existential dangers to humanity.