Research

Cloudflare Pay-Per-Crawl: State of the Marketplace in 2026

Where Cloudflare Pay-Per-Crawl actually stands in April 2026: enrolled customers, daily HTTP 402 volumes, AI-side adoption, pricing distribution, and what the data tells us about the market.

By Ramanath, CTO & Co-Founder at Presenc AI · Last updated: April 2026

The Numbers Cloudflare Disclosed

Cloudflare Pay-Per-Crawl entered private beta in July 2025 and remains the highest-profile implementation of the Pay-Per-Crawl model. As of April 2026, Cloudflare's public disclosures put the headline numbers at more than 1 million enabled customers and more than 1 billion HTTP 402 responses returned daily across the Cloudflare network. These are large, but they need decomposition to understand what is actually happening.

Enabled vs Active

Enrolled customer count and active customer count are different. The 1 million-plus enabled figure includes any Cloudflare customer who has switched on the feature, regardless of whether their PPC configuration is actually returning paid responses to crawlers. Active monetization (publishers actually receiving payments above a meaningful threshold) is a much smaller subset, estimated in the tens of thousands as of April 2026 based on aggregated marketplace activity.

The gap between enrolled and active matters for understanding adoption. Most enrolled customers are in observation mode, waiting to see what the AI labs do, what other publishers price at, and whether the operational overhead is worth the per-fetch revenue. The transition from enrolled to active accelerates when AI labs make explicit commitments to honour 402 responses, which has happened gradually through 2025 and 2026.

Daily 402 Volume Decomposition

The 1 billion-plus daily 402 responses is a network-wide aggregate across all enabled customers. The decomposition by AI bot identity reveals which AI products are actually engaging with the marketplace versus walking away.

BotEngagement with 402 responses (April 2026)
OpenAI (GPTBot, OAI-SearchBot, ChatGPT-User)Mixed: ChatGPT-User and OAI-SearchBot show payment behaviour; GPTBot more often skips paid URLs
Anthropic (ClaudeBot)Mostly skips paid URLs as of April 2026; signalled forthcoming engagement
Google (Google-Extended)Skips paid URLs in most observed cases
Perplexity (PerplexityBot)Engages with payment for specific premium-tier sources; skips most others
Bytespider, AmazonbotLargely ignores 402 responses
Smaller and unidentified crawlersMostly skips; occasional engagement

The headline implication: paid response engagement is concentrated in a few specific bot identities, primarily ChatGPT-User and OAI-SearchBot, plus selective engagement by PerplexityBot. Most AI bots still walk away from paid URLs as of April 2026. The 1 billion-plus daily 402 responses are mostly being declined, not transacted.

Pricing Distribution

Across the active publisher base on Cloudflare PPC, pricing distribution is bimodal. A large mass of publishers price between $0.001 and $0.005 per fetch (general content), and a smaller mass between $0.05 and $0.25 per fetch (premium news, primary research). The middle band ($0.005 to $0.05) is sparser because most publishers either price defensively low or aspirationally high.

The bimodality is rational given the bot-engagement pattern. Low-priced content gets enough engagement to produce non-zero revenue. High-priced content gets engagement only from premium-content-buying bots like OAI-SearchBot and PerplexityBot for specific sources, which can support meaningful per-fetch revenue. Middle-band pricing is a no-man's-land that is too high to attract general crawl engagement and too low to capture premium-content rates.

What Has Changed Since 2025

Three substantive shifts compared to the late-2025 state of Cloudflare PPC. First, OpenAI's engagement has improved meaningfully: more ChatGPT-User sessions transact paid fetches, and OAI-SearchBot has become a reliable participant for premium-tier content. Second, regional adoption has expanded: European and Asia-Pacific publishers are now meaningfully represented in active publisher mix, where the 2025 base was dominated by US publishers. Third, pricing has compressed at the low end: the floor that produces material revenue has risen from $0.0005 to roughly $0.001 as AI labs have become more selective.

What This Means for Publishers

For publishers evaluating Cloudflare PPC enrollment in April 2026, three considerations dominate. First, enrollment is low-risk and operationally simple, so default to enrolled. Second, expect modest direct revenue at first because most AI bots still walk away from 402 responses; the revenue ramps as bot engagement improves. Third, consider PPC as one channel in a broader monetization stack rather than the only channel: TollBit, ProRata, and ScalePost cover different bot composition and bilateral licensing fills the gap for major publishers.

Methodology

Headline numbers (1 million-plus enabled, 1 billion-plus daily 402 responses) are from Cloudflare's public disclosures. Decomposition by bot engagement, pricing distribution, and trend versus 2025 is from a combination of Presenc AI's own crawl analytics, customer-shared aggregated marketplace data, and published case studies from Cloudflare PPC publishers. All figures are point-in-time as of April 2026 and updated quarterly.

Frequently Asked Questions

Most are declined. The 1 billion-plus daily 402 responses include all paid-content responses, regardless of whether the AI bot pays or walks away. As of April 2026, the majority of AI bots still skip paid URLs, with OAI-SearchBot, ChatGPT-User, and selectively PerplexityBot being the main exceptions.
For most small publishers, yes. Enrollment is operationally simple and the downside is minimal. Direct revenue may be modest at first, but the upside grows as AI bot engagement improves and the negotiating leverage matters in any future bilateral discussion. Enrollment is the default.
Bot-engagement patterns reward defensive low pricing or aspirational high pricing more than middle-band pricing. Low-priced content attracts enough general crawl engagement for non-zero revenue. High-priced content attracts premium-content-buying bots for specific sources. Middle-band pricing falls in a no-man's-land that captures neither.
Cloudflare PPC is the largest by enrolled customer count and probably the largest by absolute 402 volume. TollBit, ProRata, and ScalePost have different fee structures, different bot mix, and different publisher tiers. Most large publishers participate in multiple marketplaces; small publishers often choose one based on operational fit. Detailed comparisons are in our marketplace deep-dives.

Track Your AI Visibility

See how your brand appears across ChatGPT, Claude, Perplexity, and other AI platforms. Start monitoring today.