GoKawiilSign up to see the future, today Can’t-miss innovations from the bleeding edge of science and tech Email address Sign Up Thank you!
With opposition to AI continuing to grow, a top AI lab is building out a massive surveillance apparatus meant to keep a close eye on dissenters and predict when the next groundswell of protest might occur.
News of Anthropic’s system was first reported by the American Prospect, which spoke with Anthropic senior security officials and indexed job postings to get an understanding of the dragnet.
On top of keeping tabs on protests in the vicinity of Anthropic offices, the publication notes that the AI lab is taking a “pre-crime” approach to watching for potential civil unrest.
To give an example, the Prospect points out an incident shared by Anthropic security operations managers Keon Ellison and Zach Melvin, alongside James Neufeld, CEO of risk detection company Samdesk.
“Last year we had an executive travel into a major city when we received some intelligence through Samdesk about a planned protest,” Ellison said candidly. After the scheduled protest was moved up an hour due to a mix-up with police permits, the security chief said that “Samdesk gave us about 60 minutes of advanced notice that the protest organizers had moved the timeline.”
“That extra hour was critical,” Ellison continued. “Without it our executives would have departed their meetings, they would have ran right into the heart of the disruption. What could have been a high-stress situation was really mitigated through early detection through Samdesk and giving us that information.”
Outside of anticipating protests, there were also cases where Anthropic reported conversations held with its AI chatbot Claude to police. Though there have been calls to increase safety guardrails on large language models, Anthropic’s approach sounds bizarre.
As the San Francisco Standard reported in August, Anthropic reported a San Francisco man to the cops after he told Claude he was holding a rifle, and had the company’s CEO Dario Amodei “in his sights.” Yet when Anthropic reported the conversation to Bay Area police, the company refused to provide the man’s chat logs — as the Prospect observes, essentially reporting the man without sharing any tangible evidence of misconduct.
“The goal,” as Anthropic’s security manager said in the interview, “would be transforming operations from reactive information to gathering proactive and predictive and preventative threat engagement and management. That’s the kind of operational maturity that makes sense for protecting high-value targets in any industry.”
... continue reading