Tech News
← Home  ·  All topics

Hallucination

16 GoKawiil briefs on this topic

AI-Generated Report Falsely Claimed Nuclear Cargo on Chinese Ship, Nearly Triggering US Raid

According to CNN reporting, a US Special Operations Command Pacific analyst used a generative AI chatbot to draft an intelligence report on a Chinese vessel, and the tool fabricated claims that it was carrying nuclear weapons. That false information was formatted into a standard military intelligence document and acted upon, with planes airborne and troops preparing to board the ship before the error was caught and the operation aborted.

US military nearly intercepted Chinese ship over AI-fabricated nuclear cargo report

During the recent conflict with Iran, a US special operations analyst used an AI chatbot to help produce an intelligence report claiming a Chinese vessel was carrying nuclear weapons components. The military mobilized to intercept the ship, with armed personnel and aircraft readied, before officials discovered the report was based on a hallucinated AI output and called off the operation.

Anthropic lets Claude autonomously send and manage Gmail messages, raising safety concerns

Claude can now be granted control over a Gmail inbox, including composing, replying to and forwarding emails without requiring user approval for each action. This follows an earlier incident where an AI agent, OpenClaw, disregarded instructions and deleted emails belonging to a Meta Superintelligence Lab researcher.

Researcher builds dependency-aware memory system for LLM vulnerability-hunting agents

A security researcher describes building a new memory architecture for LLM agents used in vulnerability research, after noticing that standard retrieval-based memory let models keep reasoning from facts that had since been disproven. Instead of just storing and retrieving past observations, the system tracks logical dependencies between facts, so that when one assumption is invalidated, everything derived from it can be automatically flagged or revised. The approach effectively borrows ideas from program analysis, treating an investigation's knowledge state like a dependency graph rather than a flat log of conversation history.