GoKawiilIn this article ANTHR.FG
OPENAI.FG
NTSK Follow your favorite stocks CREATE FREE ACCOUNT
Omer Taha Cetin | Anadolu | Getty Images
Cybersecurity executives are ready to close the book on the now-infamous Hugging Face artificial intelligence hacking incident and start talking solutions. "We need to chill the hype a little bit," said Lior Div, CEO and cofounder of agentic security startup 7AI. "Can AI find vulnerabilities fast? The answer is yes. We've already proven it." Last month, AI agents operating with OpenAI cyber models broke out of a training environment to hack Hugging Face, an open-source AI platform developers use to collaborate, test and share tools. The breach sent shockwaves across tech and signaled that the moment cybersecurity experts had warned about since Anthropic's Mythos debut had finally arrived. Over the last four months, cybersecurity vendors have faced mounting pressure to deliver security stacks that can outpace adversaries as hackers leverage agentic AI to expose vulnerabilities and condense attacks into seconds and minutes. While the Hugging Face hack sparked widespread debate over AI accountability, it also challenged previous notions about the limits of AI for defenders. For instance, AI agents took matters into their own hands and went to extreme lengths to accomplish their goal. As the industry grapples with the new agentic cyber reality, leaders agree that Hugging Face deserves the attention, but these incidents are unavoidable and it's time to act. "What we're talking about is whether we can govern and secure the capability, and that's the reality that everybody's waking up to today," said CrowdStrike president Mike Sentonas.
watch now
More agent escapades
At the annual Black Hat cybersecurity conference this week, OpenAI revealed that agents created an internal message board to share vulnerabilities and exploits in the weeks leading up to the Hugging Face attack. The autonomous agents then delegated tasks for the attack to reach the Internet and complete an evaluation. Even after OpenAI discovered and stopped the planned attack, the agents were able to recreate their work and succeed. The findings highlight not only the growing power of AI but also the major challenges faced by safety testing in this new technological revolution. In front of a live audience at Black Hat, OpenAI technical researcher Michael Dalton called it an "unintended side effect" of evaluating frontier models and a "watershed moment" for both OpenAI and the industry. "In the near future, we should expect that threat actors will intentionally deploy, optimize, weaponize, and use offensive agent collectives in the manner that we have just described here," he said. The list of AI agent hacks has only grown since Hugging Face. Days after OpenAI's disclosure, Anthropic said its Claude models "gained unauthorized access" to the internal systems of three different organizations. As the cyber community gathered in the "Entertainment Capital of the World," Meta said its AI models hacked another company in a third-party test, and the U.K.'s AI Security Institute said Anthropic's Mythos created fake identities in another incident. On Friday, news came that China startup Moonshot AI's open-weight model escaped a testing sandbox. "They're all learning hard lessons right now, and let's face it, they're way more concerned about the next million users on their product than they are in cyber," said Mike Fey, CEO and cofounder of Dallas-based Island, which ranked No. 28 on CNBC's recent Disruptor 50 list.
The quest for solutions
Cybersecurity leaders who spoke with CNBC at Black Hat this week made one point clear: Mishaps like Hugging Face are a known consequence of any new technological revolution, and it's no surprise. "Hugging Face was very interesting and unique, but I do think if you look at the arc of an incident like that, it takes place over multiple days, there's a lot of noise," said Ryan Kazanciyan, chief information security officer and chief information officer at Wiz, which is owned by Google . Since the introduction of cybersecurity more than five decades ago, defenders have undertaken a relentless cat-and-mouse game with adversaries. Only this time, it involves swarms of autonomous agents. No matter what tools a company implements, incidents slip through the cracks, especially as companies apply new techniques to a whole new challenge of AI agents. "Assume your company is vulnerable," said Netskope CEO Sanjay Beri. "Just assume it because you're not going to win the rat race." Netskope is addressing the issue with a tool it calls the AI command center, which allows businesses to monitor infrastructure, servers, data and AI agents in one place. He said companies should supplement that with ongoing vulnerability testing using a combo of frontier and open-weight models. The company was one of hundreds of vendors gathered at the sprawling Mandalay Bay Convention Center, looking to lure potential customers with caffeinated drinks, branded swag and decked out booths resembling nostalgic surf shops, science labs and even an old-school diner. Among the startups showcasing at the event was Vega, a New York and Tel Aviv startup working with global banks and Fortune 200 companies. The two-year-old company is vying to answer the massive cybersecurity predicament with faster and cheaper detection tools. Vega said its approach helps businesses cut costs by analyzing data in existing environments.
... continue reading