B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Recent
3.6%
3.6% -- share of sampled pages crawled for GPTBot (2025)
GPTBot crawled 3.6% of all sampled pages according to Cloudflare Radar.
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
3.6%
Unit
Percentage
Data Vintage
2025
Entity
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
95
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
Cloudflare
Primary
Tier A
https://indexcraft.in/technical/crawl-budget-optimisation-guide ↗
Source Article
Crawl Budget Optimisation Guide 2026
🕷️ What is crawl budget and how do you optimise it? (Direct answer)
Crawl budget is the number of URLs Googlebot can and wants to crawl on your site within a given timeframe — set by your server's capacity (crawl rate limit) and how much Google thinks your pages are worth revisiting (crawl demand). …
Original Research
Cloudflare
· Original study ↗
Methodology
Cloudflare Radar sampled page analysis
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
GPTBot: 3.6% share of sampled pages crawled. Source: Cloudflare (2025). Via Lighthouse Intelligence -- https://lighthousedata.io/data/gptbot-page-crawl-rate-2025
HTML Embed
<blockquote cite="https://lighthousedata.io/data/gptbot-page-crawl-rate-2025" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>3.6%</strong> -- share of sampled pages crawled for GPTBot<br><small>Source: Cloudflare (2025) · <a href="https://lighthousedata.io/data/gptbot-page-crawl-rate-2025" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.