AIToday

Patreon blocks AI training bots with Cloudflare, ends polite requests

TechCrunch AI20h ago
Patreon blocks AI training bots with Cloudflare, ends polite requests

Key takeaway

Patreon announced it is now actively blocking AI training bots using Cloudflare's technology, moving from passive requests (robots.txt files) to direct technical barriers. The change comes as AI scrapers have grown more sophisticated and ignored Patreon's earlier deterrents, and as new creator-facing features risk exposing more content to unauthorized training. The company argues creators should control how their work is used by AI companies rather than accepting it as the price of reaching an audience.

Summaries like this, in your inbox every morning.

Sign up free →

3 Key Points

  • What happened

    Patreon announced Thursday it is working with Cloudflare to directly block AI bots designed to train on creators' work without permission, moving beyond its 2023 approach of asking bots not to scrape via robots.txt files. During testing, individual AI training crawlers' weekly attempts to access Patreon dropped from thousands of attempts to zero.

  • Why it matters

    Patreon says the stricter blocking is necessary because AI scrapers have become more sophisticated and were ignoring its earlier requests, and because new discovery tools like a redesigned Home Feed and Quips could expose more creator content to crawlers. The company argues that creators deserve control over how their work is used by AI companies, rather than having to accept AI training just to reach an audience.

  • What to watch

    Patreon will still allow bots that index pages and organize information to send users back to the platform. The move uses Cloudflare's AI Crawl Control technology, part of a broader shift by the infrastructure provider—which now blocks "mixed-use" crawlers (those that both index and train) by default on pages with ads and offers a Pay Per Crawl marketplace for sites to charge AI bots for scraping.

Context & Analysis

Patreon's shift from soft deterrence to hard technical blocking reflects a wider industry reckoning with AI model training. When the company first introduced blocking measures in 2023, it relied on robots.txt—a cooperative standard that assumes good faith. But testing revealed that AI training crawlers were simply disregarding those requests and scraping anyway, making the polite approach ineffective. The timing of this upgrade is also driven by changes to Patreon's own product: the newly redesigned Home Feed and the introduction of Quips (short-form content) both threaten to surface more creator work to scrapers, making tighter controls necessary.

This move sits within a broader ecosystem shift. Cloudflare's recent policy change to block "mixed-use" crawlers by default on ad-supported pages, and its introduction of Pay Per Crawl, signal that the infrastructure layer is now actively helping publishers and creators negotiate—or refuse—the terms of AI training access. Patreon's product chief Drew Rowny frames the company's stance around creator agency: most creators online must accept AI training as the cost of reaching an audience, but Patreon's model allows creators to retain control. This positioning suggests that platforms protecting creator interests from uncompensated AI training may become a competitive differentiator.

FAQ

What bots will Patreon still allow to access its site?
Patreon will allow bots that index pages and organize information that can be used to send users back to Patreon.
Why is Patreon changing its approach now, after blocking requests since 2023?
AI scraping has become more sophisticated since 2023, and the company introduced new discovery tools like a redesigned Home Feed and Quips that could expose more content to crawlers. Testing showed that AI training crawlers were ignoring Patreon's robots.txt file and scraping anyway.
What is Cloudflare's role in this?
Patreon is using Cloudflare's AI Crawl Control technology to update its AI policies and enforcement tools. Cloudflare offers website publishers tools to restrict AI bots and also provides a Pay Per Crawl marketplace that lets websites charge AI bots for scraping.

Get the latest Robotics news every morning

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · takes 30 seconds · unsubscribe anytime

Discussion

No comments yet. Be the first to share your thoughts!

Log in to join the discussion

Related Articles

Stay ahead with AI news

Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.

Get Started Free

Free · takes 30 seconds · unsubscribe anytime

1 minute a day. The AI essentials.

200+ sources · Email / LINE / Slack

Get it free →