Bot traffic now exceeds human traffic on the internet for the first time, with bots accounting for 57.4 percent of HTTP requests. Cloudflare CEO Matthew Prince says this tipping point arrived months earlier than expected due to rapid AI agent growth, and he believes websites will eventually need to charge AI systems for access—a "pay to crawl" model. A platform Cloudflare built last summer to enable this charging has not yet gained traction, though major AI services like Google's tools already drive billions of user interactions.
Summaries like this, in your inbox every morning.
Sign up free →What happened
Bot traffic has overtaken human traffic on the internet, accounting for 57.4 percent of HTTP requests worldwide versus 42.6 percent from humans, according to Cloudflare CEO Matthew Prince. The shift occurred over the past few months, driven by rapid growth in automated traffic from AI agents—sooner than Prince expected.
Why it matters
The reversal reflects how AI systems are now consuming vast amounts of web data. Cloudflare launched a platform last summer that lets site owners gate AI crawlers and charge for access, but it has not gained traction. Prince argues the web's future will require a "pay to crawl" model supported by new protocols and infrastructure, whereas currently Google's AI Overviews and AI Mode have racked up billions of users with no clear monetization for content creators.
What to watch
Prince notes the data is still rough, but the trend is unmistakable. The company is still working on the protocols and infrastructure needed to support the volume a paid-crawl model would require.
AI-summarized, only the topics you pick — one digest a day via Email, Slack, or Discord.
Free · takes 30 seconds · unsubscribe anytime
No comments yet. Be the first to share your thoughts!
Log in to join the discussion
Get curated AI news from 200+ sources delivered daily to your inbox. Free to use.
Get Started FreeFree · takes 30 seconds · unsubscribe anytime
1 minute a day. The AI essentials.
200+ sources · Email / LINE / Slack
