GoKawiilMeta let 332 ads for AI-generated child abuse content run before removal, report finds
A Tech Transparency Project investigation found Meta took days to pull hundreds of Facebook and Instagram ads promoting AI apps that generated child sexual abuse material, some using real photos of children including a European royal and a preteen social media influencer. The ads, mostly linked to Chinese-made AI and 'nudify' apps, digitally altered images of children into sexually explicit videos and used explicit captions to lure users.
GoKawiil's interpretation of the reporting above, not reported fact.
The findings highlight how AI image tools are being weaponized to create realistic child abuse content that federal law treats as equivalent to real CSAM, yet platforms like Meta continue to struggle with detecting and removing such ads before they spread. It raises fresh questions about the adequacy of content moderation systems as generative AI makes fabricated abuse imagery cheaper and easier to produce at scale.
- Meta failed to catch 332 ads containing AI-generated CSAM before removal in 2025.
- Many ads used real photos of identifiable children, including a royal family member and a preteen influencer.
- Most offending ads promoted Chinese-made 'nudify' AI apps marketed with explicit, predatory language.
Source: arstechnica.com, 2026-09-08
Published there as: ““This is the AI men actually use”: Meta ads pushed apps nudifying real teens”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.