All posts
AI Crawlers

The Search Engine Referral Report: Google 90% Dominance in Numbers

Google controls 91.2% of search engine referrals and 81.6% of all web traffic. Analysis of 30 days of Cloudflare Radar data reveals TikTok, AI search, and crawl-to-refer ratios.

JBJames Bennett
17 minutes read
Search Engine Referral Report January 2026 - Google dominance, TikTok referrals, and AI search crawl-to-refer ratio analysis

The Search Engine Referral Report: Google's 90% Dominance in Numbers

📊 Stats Alert: Google generates 91.2% of all search engine referral traffic and 81.6% of all web referrals globally, while TikTok sends 3.6x more referral traffic than Bing. Meanwhile, Anthropic crawls 43,214 pages for every single referral it returns.

Google generates 81.6% of all web referral traffic and controls over 91% of search-engine-specific referrals, according to 30 days of Cloudflare Radar data covering January 9 through February 8, 2026. I analyzed referral patterns, crawler behavior, and crawl-to-refer ratios across Cloudflare's network of 330+ cities in 125+ countries, and the numbers paint a picture of one company's near-total control over how people discover websites.

How Much of All Web Referral Traffic Does Google Control?

According to Cloudflare Radar web crawler referral data (get_bots_crawlers_data endpoint, REFERER dimension), Google properties generate 81.6% of all identified referral traffic globally. That single number understates Google's actual dominance because it includes non-search referrers like TikTok in the denominator.

Search engine referral traffic share breakdown showing Google at 81.6% dominance compared to TikTok, Bing, Yandex, and other referral sources
Referral SourceJanuary 2026 Share (%)Category
google.*81.58%Search Engine
tiktok.com10.59%Social / Discovery
bing.com2.81%Search Engine
yandex.*1.62%Search Engine
m.baidu.com1.39%Search Engine
duckduckgo.com1.18%Search Engine
baidu.com0.36%Search Engine
chatgpt.com0.19%AI Search
cn.bing.com0.14%Search Engine

When I strip out non-search referrers like TikTok and isolate only traditional search engines, Google's share rises to approximately 91.2% of all search engine referral traffic. That's the number behind the headline. Among every 100 visitors a website receives from a search engine, roughly 91 come from Google.

The remaining 8.8% is split among Bing (3.3% combined across bing.com and cn.bing.com), Baidu (2.0% combined across mobile and desktop), Yandex (1.8%), and DuckDuckGo (1.3%). No single competitor exceeds a 3.5% share.

💡 Expert Insight:

If you're building an SEO strategy that diversifies beyond Google, the data suggests there's almost nowhere to go within traditional search. Bing, Baidu, Yandex, and DuckDuckGo combined don't reach 9% -- but TikTok alone sends more referral traffic than all of them put together.

Is TikTok Really the Second-Largest Referral Source on the Web?

The most unexpected finding in the January 2026 data is TikTok's position. According to Cloudflare Radar referral analytics, tiktok.com generates 10.59% of all identified web referral traffic -- more than Bing, Yandex, Baidu, and DuckDuckGo combined.

TikTok analytics dashboard showing referral traffic metrics and website click-through data from TikTok as the second largest referral source
Referral SourceShare (%)Multiple of Bing
TikTok10.59%3.6x
Bing (all variants)2.95%1.0x
Yandex1.62%0.5x
Baidu (all variants)1.75%0.6x
DuckDuckGo1.18%0.4x

TikTok sends 3.6 times more referral traffic to websites than Bing does. This isn't a search engine comparison -- TikTok drives traffic through in-app links, bio links, and its integrated browser -- but it reveals where users actually discover and click through to websites in 2026. For website owners who focus exclusively on search engine optimization, this is a blind spot worth addressing.

📌 Pro Tip:

If your audience is on TikTok, consider optimizing your link-in-bio, in-app browser experience, and content discovery through short-form video. TikTok referral traffic is 3.6x larger than Bing -- that's a channel worth testing.

Month-over-month, TikTok's referral share grew from 10.46% to 10.59%, a modest but steady increase of +0.13 percentage points. Bing showed stronger relative growth, climbing from 2.62% to 2.81% (+0.19 pp).

How Has Google's Referral Dominance Changed Month Over Month?

Comparing current 30-day data (January 9 - February 8, 2026) against the prior control period (December 10, 2025 - January 9, 2026), Google's referral share barely moved, according to Cloudflare Radar referral analytics.

Referral SourceDecember 2025January 2026Change (pp)
google.*81.43%81.58%+0.14
tiktok.com10.46%10.59%+0.13
bing.com2.62%2.81%+0.19
yandex.*1.68%1.62%-0.06
m.baidu.com1.46%1.39%-0.07
duckduckgo.com1.24%1.18%-0.05
baidu.com0.66%0.36%-0.30
chatgpt.com0.17%0.19%+0.02

Google's +0.14 pp gain may look small, but at 81.6% market share, it means Google's grip is tightening rather than loosening. The losers this month were Baidu (-0.30 pp, with baidu.com desktop referrals nearly halving), DuckDuckGo (-0.05 pp), and Yandex (-0.06 pp). Bing was the notable gainer among traditional search engines at +0.19 pp, potentially reflecting Microsoft's continued integration of AI features into Bing search results.

ChatGPT's referral share grew from 0.17% to 0.19% -- a 12% relative increase. While still tiny in absolute terms, I'll explain why this number matters more than it appears when I get to the crawl-to-refer ratios.

Which Search Engines Crawl the Most Relative to What They Send Back?

This is where the data gets interesting. Cloudflare Radar tracks crawl-to-refer ratios (get_bots_crawlers_data endpoint, CRAWL_REFER_RATIO dimension), measuring how many crawl requests each operator makes for every referral they send to websites. A lower ratio means the operator is more "generous" -- it sends traffic back to sites relative to the content it consumes.

OperatorCrawl-to-Refer RatioInterpretation
DuckDuckGo1.4:1Most efficient: ~1 referral per 1.4 crawls
ByteDance/TikTok2.6:1Efficient referrer relative to crawling
Baidu4.1:1Moderate
Google4.9:1Moderate: ~1 referral per 5 crawls
Yandex16.1:1Heavy crawler relative to referrals sent
Mistral21.9:1AI-focused, minimal referrals
Microsoft/Bing34.2:1Heavy crawler for its referral volume
Perplexity113.7:1AI search: crawls far more than it refers
OpenAI1,283.7:1Training-heavy, minimal referral traffic
Anthropic43,213.6:1Extreme: 43K crawls per referral sent

DuckDuckGo is the most efficient referrer on the web, sending approximately one visitor back for every 1.4 pages it crawls. Google sits at a moderate 4.9:1, meaning it crawls roughly five pages for every referral it generates -- a reasonable ratio for a search engine that also indexes images, videos, and cached content.

The ratio diverges dramatically for AI companies. Anthropic makes 43,214 crawl requests for every single referral it sends back to a website. OpenAI's ratio is 1,284:1. Even Perplexity, which positions itself as an AI search engine that cites sources, shows a 114:1 ratio. These numbers quantify a growing concern among publishers: AI companies consume massive amounts of web content while returning minimal traffic to the sites that create it.

⚠️ Warning: If you run a content-heavy website, audit your server logs for AI crawler traffic. Companies like Anthropic (43,214:1) and OpenAI (1,284:1) are consuming bandwidth at ratios that offer minimal return in referral traffic. Consider implementing rate limiting or selective robots.txt rules for AI training bots.

How Have Crawl-to-Refer Ratios Changed This Month?

OperatorPrevious 30d RatioCurrent 30d RatioDirection
Anthropic63,331:143,214:1Improving
OpenAI1,555:11,284:1Improving
Perplexity104:1114:1Worsening
Microsoft40:134:1Improving
Google5.2:14.9:1Improving
DuckDuckGo1.5:11.4:1Improving

Anthropic's ratio improved significantly from 63,331:1 to 43,214:1 -- a 32% improvement. This could reflect ClaudeBot reducing its crawl volume (its AI crawler share dropped from 13.0% to 11.4% month-over-month, as I found in my January AI crawler analysis) while maintaining or slightly increasing referral traffic. OpenAI similarly improved from 1,555:1 to 1,284:1, which aligns with the growth of ChatGPT referral traffic from 0.17% to 0.19% of all referrals.

Perplexity moved in the opposite direction, from 104:1 to 114:1, suggesting it's crawling more aggressively without a proportional increase in referral traffic sent back to publishers.

Who Dominates Search Engine Crawling?

Search engine crawlers represent 33.0% of all verified bot traffic globally, making them the single largest bot category according to Cloudflare Radar bot traffic data (get_bots_data endpoint). Among search engine crawlers specifically, Google's dominance mirrors its referral dominance.

Search CrawlerShare of Search Crawling (%)Operator
GoogleBot68.0%Google
BingBot17.4%Microsoft
Google Images5.3%Google
YandexBot3.8%Yandex
Baiduspider2.6%Baidu
Toutiao0.7%ByteDance
Google Videos0.3%Google
DuckDuckBot0.3%DuckDuckGo

When I combine GoogleBot (68.0%), Google Images (5.3%), and Google Videos (0.3%), Google accounts for 73.6% of all search engine crawler traffic. Adding the fact that Google controls 81.6% of referral traffic and 70.1% of browser market share (via Chrome), one company's infrastructure intermediates the vast majority of how content is discovered, accessed, and displayed on the web.

Microsoft's BingBot commands 17.4% of search crawler traffic -- nearly five times its referral share of 3.3%. This gap suggests Bing crawls aggressively relative to the traffic it actually sends to websites, which the crawl-to-refer ratio of 34:1 confirms.

What Does the Full Bot Ecosystem Look Like?

According to Cloudflare Radar HTTP analytics (get_http_data endpoint), bots generate 30.0% of all HTTP requests globally. Nearly one in three requests hitting websites comes from automated software rather than human visitors.

AI crawler and bot traffic breakdown by purpose showing search engine crawlers, AI training bots, and mixed-purpose crawler distribution
Traffic TypeShare of All HTTP Requests (%)
Human69.96%
Bot30.04%

Within bot traffic specifically, Cloudflare Radar's crawler analysis (get_bots_crawlers_data endpoint, CLIENT_TYPE dimension) breaks down the composition further:

Client TypeShare of All Crawler Traffic (%)
Human47.31%
Non-AI Bot43.54%
AI Bot5.06%
Mixed Purpose4.10%

And among all verified bots, search engine crawlers remain the single largest category:

Bot CategoryShare of All Verified Bot Traffic (%)
Search Engine Crawler33.01%
AI Crawler20.59%
SEO Tools12.63%
Advertising & Marketing11.57%
Page Preview6.14%
Monitoring & Analytics3.68%
Aggregator2.89%
Webhooks2.70%
AI Search2.67%

Search crawlers at 33.0% still lead AI crawlers at 20.6%, but the gap has narrowed significantly. When AI crawlers (20.6%) and AI search bots (2.7%) are combined at 23.3%, they're approaching the search engine crawler share. The web's bot ecosystem is shifting from search-indexing-dominant to AI-training-dominant faster than most site owners realize.

How Does Google's Browser Dominance Reinforce Its Search Monopoly?

Chrome controls 70.1% of all browser traffic globally, according to Cloudflare Radar HTTP analytics (get_http_data endpoint, browser_family dimension). Combined with Google's search and crawling dominance, this creates a vertically integrated ecosystem.

Browser market share chart showing Chrome at 70.1%, Safari at 16.6%, Edge at 5.8%, and Firefox at 4.0% of global web traffic in January 2026
BrowserJanuary 2026 Share (%)December 2025 Share (%)Change (pp)
Chrome70.15%70.35%-0.20
Safari16.64%17.09%-0.45
Edge5.82%5.20%+0.62
Firefox3.95%4.05%-0.10
Samsung1.84%1.81%+0.03
Opera1.36%1.35%+0.01

Edge showed the strongest month-over-month growth at +0.62 pp, climbing from 5.2% to 5.8%. This aligns with Microsoft's aggressive push to integrate Copilot AI features into Edge, potentially drawing users who want AI-assisted browsing. Safari declined -0.45 pp, though seasonal factors may contribute.

Chrome's default search engine is Google. Edge's default is Bing. Safari's default is Google (through a deal worth an estimated $20 billion annually, as revealed in the DOJ antitrust trial). This means approximately 86.8% of all browser traffic (Chrome + Safari) defaults to Google search, reinforcing the referral dominance I've documented.

Google Ecosystem Control PointShare (%)
Search referral traffic81.6%
Search engine crawling73.6%
Browser market (Chrome)70.1%
Browsers defaulting to Google search~86.8%
#1 most popular domain globallygoogle.com

These five data points illustrate how Google's dominance in one layer reinforces every other layer. Chrome funnels users to Google search, Google search generates referrals, and Googlebot crawls sites to index them for those searches.

Which Industries Receive the Most Crawler and Referral Traffic?

According to Cloudflare Radar crawler analytics (get_bots_crawlers_data endpoint, VERTICAL and INDUSTRY dimensions), the distribution of crawler traffic by industry reveals where search engines and AI bots focus their attention.

Industry VerticalShare of Crawler Traffic (%)
Shopping & General Merchandise22.93%
Internet and Telecom22.58%
Computer and Electronics19.41%
News, Media, and Publications8.37%
Gambling6.92%
Business and Industry3.77%
Finance2.93%
Professional Services2.74%
Games2.43%

The more granular industry-level breakdown shows:

IndustryShare of Crawler Traffic (%)
Retail20.36%
Computer Software17.53%
Gambling & Casinos6.41%
Marketing and Advertising6.37%
Internet5.76%
IT and Services5.64%
Media4.82%
Telecommunications3.16%

Retail at 20.4% and Computer Software at 17.5% together absorb nearly 38% of all crawler traffic. If you run an e-commerce site or maintain developer documentation, search engines and AI crawlers are among your most frequent visitors -- and the bandwidth costs of serving these bots should be factored into infrastructure planning.

A new category of AI-powered search bots is emerging alongside traditional search crawlers. According to Cloudflare Radar bot data (get_bots_data endpoint, AI_SEARCH category), two operators dominate the AI search space.

AI Search BotShare of AI Search Traffic (%)Operator
Applebot56.46%Apple
OAI-SearchBot43.34%OpenAI
Bravebot0.07%Brave

Apple dominates AI search crawling at 56.5% through Applebot, which powers Apple Intelligence features, Siri search, and Safari Suggestions. OpenAI's OAI-SearchBot holds 43.3%, reflecting ChatGPT's growing search functionality. Combined, these two operators control 99.8% of all AI search bot traffic.

AI search bots represent 2.67% of all verified bot traffic -- still a fraction of traditional search engine crawlers at 33.0%. But ChatGPT's referral share grew 12% month-over-month (from 0.17% to 0.19%), and OAI-SearchBot's crawl activity has been climbing steadily. The question for website owners isn't whether AI search will challenge Google's referral dominance, but when.

📈 Case Study:

The AI search category barely existed 18 months ago. Today, OpenAI and Apple control 99.8% of AI search crawling, and ChatGPT alone grew its referral share 12% in a single month. If you're building AI applications that need real-time web data, understanding how these search APIs work is foundational -- I break down the complete picture in my guide on what a web search API is and why it matters for AI agents.

What Should Website Owners Take Away From This Data?

Based on the January 2026 Cloudflare Radar data, here are the implications I'd prioritize:

Google's referral monopoly is as strong as ever. At 91.2% of search engine referrals and 81.6% of all referrals, any meaningful traffic strategy still starts with Google. The DOJ antitrust ruling hasn't yet changed this reality on the ground.

Don't ignore TikTok's referral power. At 10.6% of all referral traffic -- more than Bing, Yandex, Baidu, and DuckDuckGo combined -- TikTok is the second most important referral source on the web. If your audience uses TikTok and you're not optimizing for it, you're missing a traffic channel that's 3.6 times larger than Bing.

Watch AI companies' crawl-to-refer ratios. Anthropic crawls 43,214 pages for every referral it sends. OpenAI crawls 1,284. These ratios represent a direct cost to publishers: bandwidth consumed without proportional traffic returned. As AI crawler volume grows, this imbalance will become harder for content creators to absorb, particularly for smaller sites.

Bing is crawling far more than its referral share justifies. Microsoft's crawl-to-refer ratio of 34:1 is nearly seven times higher than Google's 4.9:1. BingBot represents 17.4% of search crawling but Bing generates only 3.3% of referrals. Website owners should evaluate whether serving BingBot at this volume delivers adequate return.

AI search is real but small. ChatGPT referral traffic grew 12% month-over-month, and AI search bots now represent 2.67% of bot traffic. These are leading indicators. Blocking AI search bots today means forfeiting what could become a meaningful traffic source within the next 12-18 months.

🎯 Key Takeaway: Google's referral monopoly isn't weakening -- it's tightening. But the real story in this data is the growing gap between what AI companies consume from the web and what they return. Website owners who track crawl-to-refer ratios today will be better positioned to make informed decisions about bot access policies tomorrow.

Build Smarter Search With Us

The data in this report shows how search and AI crawling are reshaping the web. Whether you're building AI applications that need real-time web data, or you want to understand how search engines and AI bots interact with your content, WebSearchAPI.ai gives you the tools to harness web intelligence through a single, fast API.

Ready to see it in action? Start building with WebSearchAPI.ai and get Google-grade results in minutes.

How I Analyzed This Data

This analysis uses data from Cloudflare Radar's crawler analytics (get_bots_crawlers_data endpoint), bot traffic analysis (get_bots_data endpoint), and HTTP traffic analytics (get_http_data endpoint), which aggregate traffic patterns across Cloudflare's global network spanning 330 cities in 125+ countries. Cloudflare's network processes over 81 million HTTP requests per second, providing one of the most comprehensive views of global internet traffic available.

I queried referral traffic breakdowns by source, crawl-to-refer ratios by operator, search engine crawler market share, browser family distribution, bot category composition, and industry-level crawler traffic patterns. The data covers January 9 through February 8, 2026, with month-over-month comparisons using a 30-day control window (December 10, 2025 - January 9, 2026).

The crawl-to-refer ratio measures how many crawl requests each operator makes relative to the referral traffic it generates. A ratio of 5:1 means the operator crawls 5 pages for every 1 referral it sends. Lower ratios indicate more efficient or generous referral behavior. All percentages represent share of identified referral, crawler, or HTTP request traffic -- not share of total internet traffic.

Data source: Cloudflare Radar -- get_bots_crawlers_data, get_bots_data, and get_http_data endpoints (radar.cloudflare.com). Last updated: February 8, 2026.

Frequently Asked Questions

What percentage of web referral traffic does Google control?

According to January 2026 Cloudflare Radar data, Google generates 81.6% of all identified web referral traffic globally. When isolating only search-engine-specific referrals (excluding non-search sources like TikTok), Google's share rises to approximately 91.2%. This makes Google the overwhelmingly dominant source of how people discover websites through search.

Is TikTok really sending more referral traffic than Bing?

Yes. TikTok generates 10.59% of all identified web referral traffic, compared to Bing's combined 2.95% (bing.com + cn.bing.com). That makes TikTok 3.6 times larger than Bing as a referral source. However, TikTok drives traffic through in-app links and bio links rather than traditional search queries, so the comparison is between a social discovery platform and a search engine.

What is a crawl-to-refer ratio and why does it matter?

A crawl-to-refer ratio measures how many pages a bot crawls for every referral (visitor) it sends back to websites. A ratio of 5:1 means the operator crawls 5 pages for every 1 visitor it returns. Lower ratios indicate more efficient or generous referral behavior. DuckDuckGo has the best ratio at 1.4:1, while Anthropic's ClaudeBot has the worst at 43,214:1 -- meaning it consumes enormous amounts of content while returning almost no traffic.

How much referral traffic does ChatGPT send to websites?

As of January 2026, ChatGPT (chatgpt.com) generates 0.19% of all identified referral traffic. While small in absolute terms, this represents a 12% relative increase from the previous month (0.17%). ChatGPT's referral traffic is growing steadily as more users adopt it for search-like queries through features like ChatGPT Search.

Should I block AI crawlers from my website?

It depends on the crawler type. AI training crawlers like ClaudeBot (43,214:1 crawl-to-refer ratio) and GPTBot (1,284:1) consume bandwidth while returning minimal traffic. Blocking these won't affect your search rankings. However, AI search bots like OAI-SearchBot are growing fast and may become meaningful traffic sources. Blocking them forfeits potential future referral traffic. For a detailed breakdown of AI crawler market share and blocking strategies, see the Monthly AI Crawler Report.

How does Chrome's market share reinforce Google's search monopoly?

Chrome controls 70.1% of browser traffic, and its default search engine is Google. Safari (16.6%) also defaults to Google through a deal worth an estimated $20 billion annually. Combined, approximately 86.8% of all browser traffic defaults to Google search, creating a self-reinforcing cycle: Chrome funnels users to Google search, which generates referrals, while Googlebot crawls sites to index them for those searches.

Is Bing's crawling proportional to the traffic it sends?

No. BingBot represents 17.4% of all search engine crawler traffic but Bing generates only 3.3% of search referrals. This gives Bing a crawl-to-refer ratio of 34:1 -- nearly seven times higher than Google's 4.9:1. Website owners receiving heavy BingBot traffic should evaluate whether the bandwidth cost is justified by the referral return.

About the Author: I'm James Bennett, Lead Engineer at WebSearchAPI.ai, where I architect the core retrieval engine enabling LLMs and AI agents to access real-time, structured web data with over 99.9% uptime and sub-second query latency. With a background in distributed systems and search technologies, I've reduced AI hallucination rates by 45% through advanced ranking and content extraction pipelines for RAG systems. My expertise includes AI infrastructure, search technologies, large-scale data integration, and API architecture for real-time AI applications.

Credentials: B.Sc. Computer Science (University of Cambridge), M.Sc. Artificial Intelligence Systems (Imperial College London), Google Cloud Certified Professional Cloud Architect, AWS Certified Solutions Architect, Microsoft Azure AI Engineer, Certified Kubernetes Administrator, TensorFlow Developer Certificate.