B
Evidence Grade B
Graded
accuracy verified by the review judge
Safe to Cite
Current
60%
60% -- share of simulations crowning false winner after 100k visitors for frequentist A/B tests with continuous peeking (2026)
With continuous peeking over 100,000 visitors, 60% of frequentist test simulations identified a false winner.
- Specific to continuous peeking conditions over 100k visitors in a simulation
Attribution:
View source
Lighthouse Research Team
Last verified:
·
How we verify data →
Source verified
Evidence graded
Value
60%
Unit
Percentage
Data Vintage
2026
Entity
Evidence Quality
B
Strong, reliable evidence
Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.
Single source - not yet corroborated
Score breakdown
Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Source
University of British Columbia
Primary
Tier B
https://kirro.io/bayesian-ab-testing ↗
Source Article
Bayesian A/B testing: when it helps (and when it doesn't)
Bayesian A/B testing measures which version of a page works better using a probability that updates as data comes in. Instead of waiting for some magic number of visitors, you get a running answer: “Version B has an 89% chance of getting more signups.”
That’s it. No statistics degree required.
Peopl…
Original Research
University of British Columbia
· Original study ↗
Methodology
Simulation study from the University of British Columbia
Methodology documented
Segmentation
Industrymarketing
Cite this stat
Plain Text
frequentist A/B tests with continuous peeking: 60% share of simulations crowning false winner after 100k visitors. Source: University of British Columbia (2026). Via Lighthouse Intelligence -- https://lighthousedata.io/data/ubc-100k-peeking-60pct-fake-winner
HTML Embed
<blockquote cite="https://lighthousedata.io/data/ubc-100k-peeking-60pct-fake-winner" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>60%</strong> -- share of simulations crowning false winner after 100k visitors for frequentist A/B tests with continuous peeking<br><small>Source: University of British Columbia (2026) · <a href="https://lighthousedata.io/data/ubc-100k-peeking-60pct-fake-winner" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Use this data in your work
Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.