B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Current
72%
72% -- ai bot robots txt violation rate for UK websites (2026)
72% of UK websites have AI bots violating their robots.txt directives according to a Cloudflare analysis.
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
72%
Unit
Percentage
Data Vintage
2026
Entity
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
Cloudflare
Primary
Tier B
https://www.365iwebdesign.co.uk/news/2026/01/30/uk-cma-google-ai-overviews-opt-out/ ↗
Source Article
UK CMA Forces Google to Let Websites Opt Out of AI Overviews | 365i
Britain's Competition and Markets Authority on 28 January 2026 proposed that website publishers be allowed to opt out of having their content used in Google's AI Overviews and AI Mode, without losing visibility in traditional search results. The conduct requirements, published under new powers in th…
Original Research
Cloudflare
· Original study ↗
Methodology
Cloudflare analysis of AI crawler compliance
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
UK websites: 72% ai bot robots txt violation rate. Source: Cloudflare (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/uk-ai-crawler-robots-violations-2026
HTML Embed
<blockquote cite="https://lighthousedata.io/data/uk-ai-crawler-robots-violations-2026" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>72%</strong> -- ai bot robots txt violation rate for UK websites<br><small>Source: Cloudflare (2026) · <a href="https://lighthousedata.io/data/uk-ai-crawler-robots-violations-2026" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.