Definition
Sample requirements scale inversely with effect size: detecting a 20% improvement needs far fewer users than detecting 2%. Low-traffic sites testing headline colors chase differences their volumes cannot statistically perceive.
Why it matters
Calculating required sample before launching a test kills the most common failure mode - ending experiments at 80% completion and shipping noise.
All glossary terms