OpenAI launches CSAM image classifier and ChatGPT warning system
OpenAI introduced a new image classifier that detects child sexual abuse material, including AI-generated images, and is offering it free via API to select companies. It also added warning screens in ChatGPT that alert users attempting to access or create content sexualizing children, temporarily suspend accounts for 24 hours, and can lead to permanent removal for repeat offenses.
GoKawiil's interpretation of the reporting above, not reported fact.
The classifier was built with the National Center for Missing and Exploited Children and is being shared through Tech Coalition and ROOST, which could extend its reach across the industry beyond OpenAI's own products. OpenAI reports the tool cuts false flags by 48% while catching the same number of abusive images, which may ease the burden on human content reviewers who face repeated exposure to disturbing material.
- OpenAI's new classifier detects CSAM, including AI-generated images, and is free to select partner companies via API.
- ChatGPT now shows warnings, temporary 24-hour suspensions, and possible permanent bans for users seeking content sexualizing children.
- The classifier was developed with NCMEC and is being distributed through Tech Coalition and ROOST to other companies.
Source: techcrunch.com — Ivan Mehta, 2026-11-16
Published there as: “OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM”
Read the original report → The summary and analysis above are GoKawiil's own, written from reporting by the source above. Facts and quotes belong to the original publisher.