Skip to content
Tech News
← Back to articles

Meta Releases Uber-Creepy AI Chatbot as Its Platforms Crumble Under Grotesque Child Abuse

read original more articles
Why This Matters

Meta is pushing a new agentic AI assistant called Muse that asks users to link accounts like Gmail and Amazon, even as reporting shows its platforms are awash in violent child-abuse content it seems unable or unwilling to police. The juxtaposition matters because Muse's usefulness depends on unusually deep access to personal data from a company with a long record of privacy failures. For consumers, it's a test of whether convenience is worth handing an AI agent the keys to your inbox and purchase history.

Key Takeaways

Sign up to see the future, today Can’t-miss innovations from the bleeding edge of science and tech Email address Sign Up Thank you!

Meta’s platforms are in a sorry state as grotesque AI slop continues to proliferate widely.

As a recent Futurism investigation found, many Facebook accounts have been flooding the platform with horrid videos depicting violent child abuse, and Meta appears to be woefully unprepared — and downright unwilling, judging by its ambiguously-phrased policies — to do anything meaningful about it.

At the same time, the Mark Zuckerberg-led company is finding plenty of new ways to creep out its user base. As part of the CEO’s lagging efforts to turn Meta into a viable competitor in the ongoing AI race, Meta launched a new AI assistant called Muse this week, and it’s already turning out to be deeply unsettling.

According to Meta’s marketing, the assistant is designed to “take the busywork off your plate,” such as booking tickets, making appointments, or filling out forms.

To actually reap any benefits, however, users have to hand over a staggering amount of trust — which, considering Meta’s catastrophic track record when it comes to protecting its users’ privacy, could easily turn out to be an absolutely terrible idea. While Meta claims the service runs on a secure “dedicated virtual machine” and that it will store login credentials in a place that cannot be accessed by the AI agent, the company has a lot of work to do to gain its users’ trust.

Perfectly illustrating the problem, as The Verge‘s Emma Roth found in her testing, Muse uncovered an “unnerving amount of information it autonomously gleaned about me.”

As part of her investigation, Roth linked both her Gmail and Amazon accounts to Muse and was immediately put off by how much personal info Muse pieced together right off the bat. It figured out the state where she was visiting her family, for instance, admitting it “pulled” data from the “shipping address on my Amazon order.”

It also listed off her “very specific interests” at a level of specificity that goes far beyond the “ad topics” section in the Instagram settings menu, which shows why certain advertisers target your account.

The experience left Roth “with an uneasy feeling about letting Muse sort through personal emails and handle my credit card.”

... continue reading