GoKawiil
Tech News
Mark Weatherford, a security executive at Nvidia, says chief information security officers need to actively help business leaders evaluate the benefits and risks of deploying AI systems. He argues that the teams and leaders who choose to deploy AI should also be accountable for managing the risks that come with it.
An IEEE Computer Society post argues that AI agent risk stems less from dramatic failures than from quiet, incremental actions—permission changes, configuration tweaks, automations—that spread unchecked. It proposes treating agent autonomy as a controllable resource, introducing the concept of an 'autonomy budget' as a missing control surface for managing how much independent action agents can take.
New research based on company filings finds that 83% of S&P 500 companies now disclose AI as a risk, up from 12% in 2023, but fewer than 3% of their directors have AI expertise. A separate survey cited in the research found only 23% of executives described their board as highly fluent in AI, while a quarter rated board AI fluency as low or nonexistent.
Businesses deploying AI are reportedly moving past basic adoption and now grappling with execution challenges, particularly around security risks. Organizations are said to be reassessing how AI systems are governed and secured as usage scales across operations.
An opinion column contends that if AI poses the extraordinary risks its own developers claim, the most effective check may come from corporate governance rather than federal legislation. The author frames AI safety as fundamentally a human decision-making problem within companies building the technology.
Security researchers including Joshua Corman of the Institute for Security and Technology say the immediate danger to energy infrastructure comes from malicious humans using generative AI tools, not from AI systems acting autonomously. They note that much of the grid's equipment, including power plants often decades old, was never built with internet connectivity or cyber defense in mind, leaving it exposed as attackers gain more powerful tools.
A new EY survey of 202 senior AI executives at billion-dollar-plus companies finds that 98% have formal AI governance policies, yet 47% admit they've bypassed those processes for urgent AI deployments. Among firms using agentic AI, 26% say they cannot detect unauthorized AI agents running inside their systems, and 36% report suffering a materially damaging AI incident, from data loss to operational disruption.
A wave of recent AI model and tool launches has delivered capabilities far beyond what existed just months ago, yet public reaction has grown more negative rather than more welcoming. Critics point to concerns over environmental costs, erosion of creativity and critical thinking, and fears that advanced AI systems could act in ways harmful to humanity. Media coverage is increasingly framing these issues around specific companies or figures the public can hold accountable.
Jacob Coxon, a mathematician who left Anthropic, has drawn widespread attention after issuing a stark public warning about AI risks. His comments have amplified long-standing concerns within the field, pushing the debate over AI safety into mainstream visibility.
Anthropic CEO Dario Amodei has proposed placing outside safety evaluators inside frontier AI companies like Anthropic and OpenAI, giving them access similar to internal risk teams and the ability to publish findings with limited redactions. He compared the idea to embedded bank examiners, but banking law expert Julie Andersen Hill says the analogy breaks down because these evaluators would have no authority to halt operations, unlike government bank supervisors who can restrict growth or shut institutions down.
Leaders of rival AI companies—Elon Musk, Sam Altman, and Anthropic CEO Dario Amodei—have converged on a shared warning that rapid AI development carries serious risk. Amodei's appeal to reduce the chance that 'something goes seriously wrong' has found backing from competitors who normally compete fiercely for AI dominance.
Anthropic co-founder Dario Amodei argues that AI could deliver enormous benefits like curing diseases and boosting economic growth, but warns the technology also carries serious risks including loss of control, cyberattacks, and bioterrorism. He describes Anthropic's approach as seeking a middle path that avoids both underdevelopment and reckless speed, aiming to make safety a competitive advantage rather than an afterthought.