From Steven Spielberg's creepy "AI" (2001) to M3GAN (2022), toys imbued with artificial intelligence have been a source of fascination and terror in pop culture for decades.
Now, in the face of all those cautionary tales, a new class of vaguely menacing chatty toys are being sold online — but unlike the "Gremlin"-esque Furbies of yore, these are powered by cutting-edge AI, and their danger quotient lies in what they may tell children or share with outside companies.
As the New York Times reports, these next-generation talking stuffed animals run the gamut of quality and authenticity, but all have one major ask: that parents trust that their young kids will be safe playing with toys that are connected to such a fraught technology.
That's a mighty tall order given how much harm has been done to kids from supposedly "child-friendly" chatbots, which Futurism has documented extensively.
The first, best-known, and likely safest of these AI-infused stuffed toys are made by Curio, a Silicon Valley-based startup that boasts a bespoke, child-friendly chatbot and voice acting by electronic musician and Elon Musk ex Claire "Grimes" Boucher.
As you can see from the photos below, these three plushies are indeed adorable — they're $100 apiece, if you're curious — but there's more to them than meets the eye, and we're not just talking about the chatbots, microphones, and voice boxes built inside of them.
In an interview with Boucher posted on the Curio site and pegged to the company's launch announcement in late 2023, the AI-enthused artist said that the toy she designed, Grok — no relation to her ex's supremely bigoted chatbot — was trained on OpenAI's API and interactive Discord conversations.
That statement, and others on Curio's official site, don't take into account a strange caveat found in the company's privacy policy acknowledging that Microsoft's Azure Cognitive Services, OpenAI, Perplexity AI, and the parental verification platform Kids Web Services may all "collect or maintain personal information from children through the App or Device." As the NYT notes, that runs counter to the company's claims that it doesn't retain kids' interactions for anything other than parental review in the toys' apps, and we've reached out to Curio to ask what all that is about.
For all that privacy dubiousness at Curio, there are similar toys sold by no-name brands that are, somehow, even sketchier.
These random sites, with names like "Little Learners" and "FoloToy," vary in their specifics if not their price ranges, which are roughly the same as the toys sold by Curio. Little Learners is the shadiest of the two, with its Trustpilot rating of 2, AI-generated graphics of kids and their families with the toys, and zero details about what AI undergirds the chatbot built into the product.
... continue reading