GoKawiilA Spanish organization has suffered a personal data breach at the hands of an agentic AI system (with human oversight).
On Sept. 14, Spain's Data Protection Agency (AEPD) — the Spanish government's data protection watchdog — described a breach report submitted by an unnamed organization, in which an unidentified hacker used a "well-known language model" to breach corporate personal data stores. Details are scarce, but the AI appears to have discovered and exploited a set of loose credentials, plus an enterprise application vulnerability, allowing its proprietor to modify personal data records and access corporate invoices.
Dark Reading contacted the AEPD for further details on this story, and will update this article should the agency provide any.
Profile of an Agentic Data Breach
In June, Spain's National Cryptologic Center (CCN) published a report warning about the "paradigm shift" malicious AI represents for cybersecurity. "Its impact lies not only in the emergence of new threats, but in the ability to accelerate, scale and automate known techniques, drastically reducing the time between identifying a vulnerability and exploiting it," the agency wrote (machine-translated by Dark Reading).
Related:China's FamousSparrow APT Spies on US Politics in Latin America
It was never going to take long for this prediction to become reality in Spain itself. According to AEPD, an unidentified human puppeteer recently used AI to accelerate, automate, and likely reduce the time it would've otherwise taken them to identify a vulnerability in a corporate application, and exploit it to reach personal data.
As CCN noted in its report, "By combining open-source intelligence with direct reconnaissance capabilities against infrastructure, attackers can precisely map digital assets such as websites, programming interfaces, cloud services or infrastructure-as-a-service environments." Indeed, the attacker first instructed their AI to search for vulnerabilities in "generic" files belonging to a victim organization, according to AEPD. That activity turned up corporate credentials, evidently, as the AI was then able to facilitate a successful login to an internal system.
"AI makes it possible to discover, chain together and exploit vulnerabilities in much shorter timeframes, limiting the ability of organizations to react," CCN warned in the spring. "Just the same, once inside of the particular corporate application their login afforded access to, our enterprising attacker's AI searched for vulnerabilities in that application's environment. This worked, allowing its human owner to modify personal data in the system and access invoices."
Related:Cyber Op Targets South Korean Media & Automotive Sectors
... continue reading