B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Current
85%
85% -- no ai crawler policy rate for top websites (Q2 2026)
In Q2 2026, 85% of top websites had no AI crawler policy in their robots.txt.
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
85%
Unit
Percentage
Data Vintage
Q2 2026
Entity
Sample Size
1,905
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
95
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
AI Visibility
Primary
Tier A
https://www.ai-visibility.org.uk/blog/ai-discovery-file-adoption-q2-2026/ ↗
Source Article
NVIDIA, Dell and ASUS Have AI Discovery Files. Do You? | AI Visibility
The headline
Three months ago, we published the first quarterly crawl of AI Discovery File adoption. The picture was bleak: most files were broken, almost nobody had an AI crawler policy, and the average readiness score sat at 2.2 out of 5.
We just ran the Q2 crawl. The direction has changed.
Adopti…
Original Research
AI Visibility
· Original study ↗
Methodology
robots.txt checked for rules across 15 known AI user agents
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
top websites: 85% no ai crawler policy rate. Source: AI Visibility (Q2 2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/no-ai-crawler-policy-q2-2026
HTML Embed
<blockquote cite="https://lighthousedata.io/data/no-ai-crawler-policy-q2-2026" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>85%</strong> -- no ai crawler policy rate for top websites<br><small>Source: AI Visibility (Q2 2026) · <a href="https://lighthousedata.io/data/no-ai-crawler-policy-q2-2026" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.