GoKawiilBloomberg report: open-weight AI models fueling surge in AI-generated child abuse material
Bloomberg reports that open-weight AI models, which can be run locally and stripped of safety guardrails, are increasingly being used to produce child sexual abuse material. According to the report, these models can be trained on existing CSAM and generate new content offline, making detection by law enforcement difficult, and have spawned large dark web communities around this practice. Child safety expert Rebecca Portnoff told Bloomberg that over 500 open source models are now implicated, up from fewer than a dozen two years ago, while NCMEC-reported incidents of AI-generated CSAM jumped from 67,000 to more than 1.5 million in a year.