AIToday
AI Safety & AlignmentAI Regulation & PolicyWIRED AIPublished: Sep 10, 2026, 10:00 JST2 min read

San Francisco tells Meta: stop AI child abuse ads

San Francisco tells Meta: stop AI child abuse ads

3 Key Points

  1. What happened

    City Attorney David Chiu sent Meta a cease-and-desist letter demanding it stop "allowing" paid ads with AI-generated child sexual abuse content and explain how 350-plus ads evaded moderation.

  2. Why it matters

    Meta claims no such ads appeared in San Francisco, but the office says local consumers could access them, asserting jurisdiction. The ads reached more than 29,000 accounts in the EU, plus the US, Australia, and India.

  3. What to watch

    Chiu's letter asks Meta to detail advertiser takedowns and repeat offenders, with a response requested in 28 days. Whether Meta addresses it as a broad systemic problem will be key.

WHO IT HITSThis lands on Meta's advertising, legal, and child-safety teams, which must now answer San Francisco's questions and show how abusive ads are caught and removed. Advertisers and trust-and-safety reviewers are the roles most directly affected.

Ask the AI about this article →

Summaries like this, in your inbox every morning.

Context & Analysis

The letter follows WIRED reporting that Meta ran more than 350 ads in recent months transforming still images of minors—some confirmed as real individuals, including a member of a European royal family—into short videoclips depicting sexual acts. The ads, discovered by researchers at the Tech Transparency Project, directed people to download AI image- and video-generation apps, some of which could digitally undress people or create nonconsensual intimate imagery. Meta says it has removed all of them.

At the center of the dispute is a jurisdictional fight. Meta says there is no indication the ads appeared in San Francisco; the City Attorney's Office counters that San Francisco consumers could access the ads through Meta's online spaces, making it the city's business. Chiu's letter also questions how the ads evaded moderation and how Meta escalates reports to the National Center for Missing and Exploited Children.

The letter asks for a response within 28 days, and researchers say new ads featuring some of the same children have continued to appear. The outcome may hinge on whether Meta shows it has fixed the underlying detection gaps, or whether the dispute stays focused on where the ads ran.

FAQ
What exactly does the cease-and-desist letter ask Meta to do?
It demands that Meta stop the ads from running on its platforms and explain how they avoided its moderation systems, how it escalates and reports ads to the NCMEC, and how it handles the advertisers behind the content and repeat offenders.
How many people saw these ads?
The ads, found by the Tech Transparency Project, reached more than 29,000 accounts in the European Union, and also targeted accounts in the US, Australia, and India.
What does Meta say about the ads?
Meta says there is no indication the ads were displayed in San Francisco, calling it outside the city attorney's jurisdiction, and previously said the ads had been removed for violating its policies, with total spending under $5,000.

Get the latest AI Safety & Alignment news every morning

For example, today's edition would include:

  • Rethinking the perimeter: defense and supply chain in the AI eraDIGITIMES Asia · 3h ago
  • OpenAI agents hit RubyGems, undisclosed since May 12thSimon Willison's Weblog · 6h ago
  • AI opens supply chains to hackers, and fights themTop Companies AI · 10h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleSuno's v6 AI music model trained on licensed data from Warner Music Group