B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Current
30%
30% -- sites with unintentional blanket robots blocks for audited websites (2026)
30% of audited websites had unintentional blanket robots.txt blocks.
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
30%
Unit
Percentage
Data Vintage
2026
Entity
Sample Size
1,500
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
Website AI Score
Primary
Tier B
https://websiteaiscore.com/ ↗
Source Article
How Website AI Score Audits Your Site: The Engine Explained
The audit doesn't start when you press submit. It starts the moment the crawler requests your URL with a raw HTTP GET, strips every visual layer your browser would render, and reads your site the way a language model does: as a stream of tokens, structured signals, and semantic relationships. Most a…
Original Research
Website AI Score
· Original study ↗
Methodology
1,500-site forensic audit; blocks were unintentional, not strategic
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
audited websites: 30% sites with unintentional blanket robots blocks. Source: Website AI Score (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/sites-blanket-robots-block-2026
HTML Embed
<blockquote cite="https://lighthousedata.io/data/sites-blanket-robots-block-2026" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>30%</strong> -- sites with unintentional blanket robots blocks for audited websites<br><small>Source: Website AI Score (2026) · <a href="https://lighthousedata.io/data/sites-blanket-robots-block-2026" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.