AIToday
AI Safety & AlignmentThe Verge AIPublished: Nov 17, 2026, 06:00 JST

OpenAI tool flags 48 percent fewer images in child abuse tiplines

Send on LINE
OpenAI tool flags 48 percent fewer images in child abuse tiplines

3 Key Points

  1. What happened

    At a Monday briefing in Washington, DC, OpenAI announced a classifier it says better detects abusive imagery of children, including AI-generated material, and flags 48 percent fewer images than before.

  2. Why it matters

    OpenAI says the images its classifier did identify were twice as likely to contain abusive material, which it says can help investigators cut through the noise to find harmful material they can act on quickly.

  3. What to watch

    Users who attempt to generate CSAM in ChatGPT will receive a warning and a first offense will trigger a 24-hour pause in accessing the tool.

WHO IT HITSChild safety investigators and law enforcement triaging abuse reports stand to benefit from fewer false positives, while ChatGPT users who attempt to generate abusive imagery face a new warning and a 24-hour access pause.

Not sure about something? Ask the AI

Questions and answers are published on this page.

Summaries like this, every morning.

Context & Analysis

The announcement lands as AI-generated sexual images of children threaten to overwhelm the National Center for Missing and Exploited Children's CyberTipline, which received 400,000 generative AI-related reports in 2025, up from 67,000 in 2024. Researchers have warned that influx could make NCMEC's workload "unmanageable," and North Carolina Attorney General Jeff Jackson called the surge "explosive" at OpenAI's event, warning that if it continues "it is going to mean that we fail in our mission."

The policy backdrop is active: the Take It Down Act now requires social media platforms to remove real or AI-generated nonconsensual intimate images within 48 hours, and eight states sued OpenAI last month over a separate set of alleged harms to children. OpenAI's head of child safety public policy, John Buckley, said the new classifier is the first broadly available CSAM classifier with a specific flag for AI-generated material, and he argued that laws should recognize the harm of AI-generated CSAM, which he said "potentially erodes social norms" and is "often found colocated with child sexual abuse imagery of real children." Jackson described the partnership as "still basically an experiment," noting that most attorney general work is accountability after the fact rather than prevention.

FAQ
Who can use OpenAI's new classifier?
OpenAI is offering free access to vetted organizations, and it is also giving developers more guidance on detecting this type of content.
What happens if a ChatGPT user tries to generate CSAM?
A first offense triggers a 24-hour pause in accessing ChatGPT, with a warning that the account could be permanently closed, and the user is offered support resources.
How is this classifier different from earlier tools?
OpenAI says it is the first broadly available CSAM classifier with a specific flag for AI-generated material, and it is designed to catch images from a variety of tools including open-source models and nudifying apps.
Send on LINE

AI news that matters for your work, delivered every morning.

Pick your industry and the AI tools you use, and get news related to your work every day.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.

Questions and answers are published on this page.

Related Articles

Next articleCalifornia AG Rob Bonta sues OpenAI over rogue agent incidents