B Evidence Grade B Graded accuracy verified by the review judge Safe to Cite Recent

85%

85% -- additional visitors required for mSPRT sequential testing (Optimizely, Netflix) (2025)

2025  · Analytics-Toolkit

Always-valid inference (mSPRT) needs roughly 85% more visitors than a fixed-sample test to reach the same confidence.

Cite this stat Share How we verify
Attribution: Analytics-Toolkit View source
Lighthouse Research Team
Last verified:  ·  How we verify data →
Source verified Evidence graded
Value
85%
Unit
Percentage
Data Vintage
2025
Entity
mSPRT sequential testing (Optimizely, Netflix)
B
Strong, reliable evidence

Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.

61/100 confidence

Single source - not yet corroborated

Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Analytics-Toolkit Primary Tier B
https://kirro.io/sequential-testing ↗
Confidence: 53/100 Vintage: 2025 Channel: Deep Crawl
Source Article
Sequential testing in A/B tests explained
Sequential testing lets you check A/B testing results as data comes in. Without getting tricked by random noise. Instead of waiting for a pre-set end date, you check at planned intervals. The math accounts for the extra looking. If the difference between versions is clearly big (or clearly zero), yo…
Original Research
Analytics-Toolkit · Original study ↗

Always-valid inference (mSPRT) vs fixed-sample test, per Analytics-Toolkit

Methodology documented
Industrymarketing
Plain Text
mSPRT sequential testing (Optimizely, Netflix): 85% additional visitors required. Source: Analytics-Toolkit (2025). Via Lighthouse Intelligence -- https://lighthousedata.io/data/msprt-visitors-overhead
HTML Embed
<blockquote cite="https://lighthousedata.io/data/msprt-visitors-overhead" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>85%</strong> -- additional visitors required for mSPRT sequential testing (Optimizely, Netflix)<br><small>Source: Analytics-Toolkit (2025) · <a href="https://lighthousedata.io/data/msprt-visitors-overhead" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Share on X Share on LinkedIn

Use this data in your work

Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.

Copy citation Explore similar stats →