B Evidence Grade B Graded accuracy verified by the review judge Safe to Cite Current

80%

80% -- ab test no positive effect rate for large enterprise experimentation programs (Microsoft, Amazon) (2026)

2026  · Ron Kohavi

Even at the world's best companies, 80-90% of A/B tests show no positive effect.

  • Reported as a range of 80-90%
Cite this stat Share How we verify
Attribution: Ron Kohavi View source
Lighthouse Research Team
Last verified:  ·  How we verify data →
Source verified Evidence graded
Value
80%
Unit
Percentage
Data Vintage
2026
Entity
large enterprise experimentation programs (Microsoft, Amazon)
B
Strong, reliable evidence

Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.

60/100 confidence

Single source - not yet corroborated

Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Ron Kohavi Primary Tier B
https://kirro.io/ab-testing-software ↗
Confidence: 53/100 Vintage: 2026 Channel: Wayback
Source Article
Best A/B Testing Software 2026: 13 Tools Compared | Kirro
Kirro, VWO, and Optimizely lead the pack for most teams. But the right A/B testing software depends on your traffic, budget, and willingness to tinker. What works for a 200-person company with a dedicated testing team is overkill for a solo founder with 30 minutes between meetings. We’ve tested, use…
Original Research
Ron Kohavi · Original study ↗

Statement by Ron Kohavi (ex-Microsoft/Amazon experimentation lead); range 80-90%, midpoint used

Methodology documented
Industrymarketing
Plain Text
large enterprise experimentation programs (Microsoft, Amazon): 80% ab test no positive effect rate. Source: Ron Kohavi (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/kohavi-tests-no-positive-effect
HTML Embed
<blockquote cite="https://lighthousedata.io/data/kohavi-tests-no-positive-effect" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>80%</strong> -- ab test no positive effect rate for large enterprise experimentation programs (Microsoft, Amazon)<br><small>Source: Ron Kohavi (2026) · <a href="https://lighthousedata.io/data/kohavi-tests-no-positive-effect" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Share on X Share on LinkedIn

Use this data in your work

Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.

Copy citation Explore similar stats →