B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Dated
12%
12% -- share of top sites blocking ai crawler for OpenAI GPTBot (2023)
12% of the top 1,000 most-visited websites online blocked OpenAI's web crawlers following the August 2023 announcement.
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
12%
Unit
Percentage
Data Vintage
2023
Entity
Sample Size
1,000
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
digiday.com
Primary
Tier B
https://bestofai.com/article/wtf-is-openais-gptbot ↗
Source Article
WTF is OpenAI’s GPTBot?
1
Feature Story
WTF is OpenAI’s GPTBot?
Sep 11, 2023 · digiday.comThe issue at hand is that generative AI tools like ChatGPT have been bypassing paywalls and using the content to inform their large language models. OpenAI's new feature aims to make it easier for publishers to protect their content. …
Original Research
digiday.com
· Original study ↗
Methodology
Analysis of top-1000 websites' robots.txt blocking of OpenAI crawlers since August 2023 announcement
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
OpenAI GPTBot: 12% share of top sites blocking ai crawler. Source: digiday.com (2023). Via Lighthouse Intelligence -- https://lighthousedata.io/data/top-sites-blocking-gptbot-2023
HTML Embed
<blockquote cite="https://lighthousedata.io/data/top-sites-blocking-gptbot-2023" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>12%</strong> -- share of top sites blocking ai crawler for OpenAI GPTBot<br><small>Source: digiday.com (2023) · <a href="https://lighthousedata.io/data/top-sites-blocking-gptbot-2023" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.