B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Current
70%
70% -- share of tests without enough visitors for real A/B tests analyzed (2026)
Nearly 70% of 115 analyzed real A/B tests did not have sufficient visitor traffic to detect a statistically meaningful difference.
- The source states 'nearly 70%'
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
70%
Unit
Percentage
Data Vintage
2026
Entity
Sample Size
115
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
50
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
kirro.io
Primary
Tier C
https://kirro.io/a-b-testing-mistakes ↗
Source Article
11 A/B testing mistakes (and how to avoid them)
You’re running A/B tests. That already puts you ahead of most websites. But running tests and running them well are two different things.
Bad tests are worse than no tests. They give you confidence in the wrong answer. You make changes based on data that looked real but wasn’t. Then conversions drop…
Original Research
kirro.io
· Original study ↗
Methodology
Analysis of 115 real A/B tests, cited by Kirro
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
real A/B tests analyzed: 70% share of tests without enough visitors. Source: kirro.io (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/ab-tests-underpowered-70pct
HTML Embed
<blockquote cite="https://lighthousedata.io/data/ab-tests-underpowered-70pct" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>70%</strong> -- share of tests without enough visitors for real A/B tests analyzed<br><small>Source: kirro.io (2026) · <a href="https://lighthousedata.io/data/ab-tests-underpowered-70pct" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.