Cloudflare's bouncer now runs the bank for AI agents

Cloudflare, gatekeeper for more than a fifth of the web, gave AI agents identity handles and stablecoin wallets in August and now blocks unpaid training crawlers by default, with Google already sending publishers 18 crawls per visitor at zero ad revenue. Visa, Mastercard and Ant International are building a rival agent ID scheme, and no jurisdiction has settled who pays when an agent buys wrongly.

In this storyNET
Vincent JiangVincent Jiang · 2 min read
Share
Cloudflare co-founder and CEO Matthew Prince seated on stage at TechCrunch Disrupt, hands clasped, wearing a headset microphone
1 / 7Slide 1 of 7
Cloudflare co-founder and CEO Matthew Prince on stage at TechCrunch Disrupt. Prince says bots passed human traffic on the web in May 2026 and wants AI companies to pay for the crawls.

The gate and the till are the same company

Cloudflare sits in front of more than a fifth of the web, which made it the first to see bots pass human traffic, in May 2026 56. The bill lands on the far side of its gate: Google now hits publishers with roughly 18 crawls for every visitor it sends back, and a crawl earns no ad revenue 1.

On 4 August the company announced Cloudflare Wallets and cloudflare.pay. Agents get a human-readable identity handle, plus a Virtual Wallet bounded by spending caps, approved merchants and a maximum transaction size, funded in stablecoins from a human-run Account Wallet 34. "When an agent shows up at your door, you need to know who sent it," Prince said 3.

The traffic math that justifies a toll

From 15 September, Cloudflare's defaults for free customers block Google's crawler from AI training, and block Google outright unless it splits training crawls from search 61. The leverage is measurable: the company's Radar monitor put bots at 60.6% of requests to HTML pages in the week to 10 August 7.

Google's crawl-to-visitor ratio has slid from roughly 6:1 to 18:1 1. Extrapolated, Prince says, automated traffic reaches 1,000 times human volume by 2031; his own caveat is blunt: "I've gone wrong so far in every prediction that I've made on this" 6.

Bots passed humans in May and Prince projects effectively all traffic by 2031

  • Estimate
0%20%40%60%80%100%Humans, Aug 202639.4%Bots, Aug 202660.6%bots first passed humans in May 2026Bots, 2031 projection99.9%Parity with humans (50%)
Data
Value
Humans, Aug 202639.4%
Bots, Aug 202660.6%
Bots, 2031 projection (estimate)99.9%
Share of requests to HTML content on Cloudflare's network; August 2026 bars are Cloudflare Radar's weekly reading (seven days to 10 August 2026). The 2031 bar converts Prince's stated 1,000-times-human projection to a share of total requests. Sources: Crypto Briefing [1]; Fortune [5]; The Verge [6]; Search Engine Journal [7].1,5,6,7

Four rails, one missing liability

Wallet payments clear over x402, a payment protocol now housed at a Linux Foundation body whose members include Visa, Mastercard, Google and Stripe 78. Sending or receiving an x402 payment requires a compatible wallet, and Cloudflare Wallets is built as the native option 4.

The networks are hedging anyway. On 10 September, Visa, Mastercard and Ant International opened a shared Know-Your-Agent framework through a Monetary Authority of Singapore platform 9. Visa's Trusted Agent Protocol, Mastercard's Agent Pay and Google's AP2, now backed by Etsy, circle the same problem 210. None settles who pays when an agent transacts wrongly; authentication is a precondition, not an answer 2.

Almost none of it works yet

Only handle reservation is live; funding, spending and merchant support are "coming months," with no published pricing and no AI company named as a paying customer 37. Settlement is peer-to-peer into the seller's wallet, so Cloudflare runs the identity, the onramp and the gate, but not the money itself; it still issues the credential, the wallet and the onramp, the accounts rather than the vault 7. If pay-per-crawl ever displaces ads, the toll booth and the bank both sit at its edge. The tell: whether the Know-Your-Agent talks absorb cloudflare.pay or fence it out.

How this brief was made

01Gathered & sourced220 channels · 2,202 articles▾

Agents swept 220 channels and ingested 2,202 articles, then de-duplicated and ranked them for signal.

02Verified & cross-validated10 claims · 10 data feeds▾
03Reviewed & edited1 human editor▾

One editor read the draft against the evidence, tuned the framing, and signed off before it shipped.

Become a contributor

Reporting on the business of AI and want it read? We take pitches from outside contributors who bring primary sources and a number worth arguing about.

Share

Deepdive

AI-generated from this story and its cited sources. Not investment advice.

Reader comments

0 comments

    Sign up

    Get your curated digest

    After email confirmation, you will receive a daily digest of the most relevant news that matter to your portfolio