B Evidence Grade B Graded accuracy verified by the review judge Safe to Cite Recent

191,000

191,000 -- required sample size per group for A/A testing at 0.6% click-through rate (2025)

2025  · Kirro

For a typical click-through rate of 0.6%, approximately 191,000 visitors per group are required to detect a change to 0.65%.

  • Example calculation based on detecting a change from 0.6% to 0.65% CTR
Cite this stat Share How we verify
Attribution: Kirro View source
Lighthouse Research Team
Last verified:  ·  How we verify data →
Source verified Evidence graded
Value
191,000
Unit
Count
Data Vintage
2025
Entity
A/A testing at 0.6% click-through rate
B
Strong, reliable evidence

Sourced from a well-regarded research firm or industry leader with transparent methodology and a reasonably large sample.

61/100 confidence

Single source - not yet corroborated

Extraction
75
Source Trust
60
Citation Chain
20
Independence
30
Methodology
45
Freshness
95
Kirro Primary Tier B
https://kirro.io/aa-testing ↗
Confidence: 53/100 Vintage: 2025 Channel: Deep Crawl
Source Article
AA test: how to run one and read the results
An AA test (also called an A/A test) runs two identical versions of the same page against each other. Same content. Same design. Same everything. The goal isn’t to find a winner. It’s to make sure your testing tool actually works before you trust it with real decisions. Think of it like stepping on …
Original Research
Kirro · Original study ↗

Statistical power calculation example to detect change to 0.65%

Methodology documented
Industrymarketing
Plain Text
A/A testing at 0.6% click-through rate: 191,000 required sample size per group. Source: Kirro (2025). Via Lighthouse Intelligence -- https://lighthousedata.io/data/aa-test-sample-size-ctr
HTML Embed
<blockquote cite="https://lighthousedata.io/data/aa-test-sample-size-ctr" style="border-left:3px solid #2563eb;padding:12px 16px;margin:16px 0;font-family:system-ui,sans-serif;background:#f0f4ff;"><strong>191,000</strong> -- required sample size per group for A/A testing at 0.6% click-through rate<br><small>Source: Kirro (2025) · <a href="https://lighthousedata.io/data/aa-test-sample-size-ctr" target="_blank" rel="noopener">Lighthouse Intelligence</a></small></blockquote>
Share
Share on X Share on LinkedIn

Use this data in your work

Copy the citation, embed the widget, or explore thousands more verified marketing statistics -- all free.

Copy citation Explore similar stats →