AIToday
AI Regulation & PolicyAI Business & IndustryFortune AIPublished: Sep 18, 2026, 22:00 JST

Cloudflare's Prince: bots passed humans, now AI must pay

Cloudflare's Prince: bots passed humans, now AI must pay

3 Key Points

  1. What happened

    Cloudflare CEO Matthew Prince says bot requests hit almost 60% of web traffic in May, and Cloudflare this week announced a "Disallow AI Training" setting. Apple, Google and Microsoft agreed to it.

  2. Why it matters

    The setting lets a site stay indexed for search while blocking training crawlers, giving publishers a way to separate "index me" visitors from "train on me" crawlers.

  3. What to watch

    Prince says automated traffic could reach 1,000 times human traffic in five years, so the test is whether AI companies actually pay for content they train on.

WHO IT HITSPublishers, news outlets and dictionary publishers pursuing copyright suits against AI companies gain a practical lever, while AI companies that rely on web content for training face pressure to negotiate payment.

Not sure about something? Ask the AI

Summaries like this, in your inbox every morning.

Context & Analysis

Matthew Prince had expected web traffic from automated bots and AI agents to surpass human traffic at the end of next year. Instead, it happened in May, with Cloudflare reporting almost 60% of requests to websites coming from bots. Cloudflare manages traffic for more than a fifth of the web and counts 80% of the top AI companies as customers, so its data offers a rare window into how much of the web is now machine-driven.

The "Disallow AI Training" setting arrives as Sony and Warner Music, news outlets and even major dictionary publishers pursue copyright suits against AI companies over intellectual property claims. Prince frames the problem as two-sided: compensation and recognition. He says the media world of the last 30 years rewarded popularity, while the next 30 might reward credibility, and he worries the industry has not thought enough about how to make sure people get recognized. He suggests there should be an Academy Award or Nobel Prize of knowledge.

Prince describes the world he is playing for as one with 500,000 AI companies rather than five. Whether the new setting changes actual payment flows likely hinges on how many AI companies follow Apple, Google and Microsoft in honoring it, and on whether courts back the publishers' claims.

FAQ
What does Cloudflare's "Disallow AI Training" setting do?
It lets a website stay indexed for search on a crawler while blocking that crawler from training on its content. Apple, Google and Microsoft have agreed to the deal.
How much of web traffic is now bots?
Cloudflare reported almost 60% of requests to websites coming from bots in May. Prince had expected that milestone at the end of next year.
Why does Matthew Prince want AI companies to pay?
He says companies need to get paid by AI companies for what is the fuel that runs these AI systems. Many AI crawlers ingest content to train models that may never send a reader or a cent back to the site.

Get the latest AI Regulation & Policy news every morning

For example, today's edition would include:

  • China plan spotlights synthetic diamond for AI chip coolingDIGITIMES Asia · 1h ago
  • Jensen Huang: don't regulate AI like social mediaSemafor Tech · 1h ago
  • 42 mathematical fellows warn Royal Society on AI riskTHE DECODER · 1h ago

AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.

Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →

Ask AI

Ask AI anything about this article. Q&As are published on this page for other readers too.

Related Articles

Next articleAmodei slowdown call hits Kioxia shares, down over 10%