No. 265 · Evidence · Human Nature and Judgement
Overgeneralising from Small Samples
Small samples swing wildly by chance, so their patterns often vanish when you look again.
In the Almanac
“The Mozart effect”, 1993–1998 · “Segway”, 2001
Both stories in full, three ways to use it and where it misleads.
Get the AlmanacListen · Watch
Questions
What is Overgeneralising from Small Samples?
Overgeneralizing from Small Samples means drawing big conclusions from too little evidence. Small samples swing wildly by chance, so a handful of anecdotes or one tiny study, like the 36-student Mozart effect experiment, can create beliefs that later collapse.
How do you use Overgeneralising from Small Samples?
To use it, ask how many cases support a claim and whether they were chosen fairly. Treat early feedback as a hint, test with wider groups before scaling, and give people several chances before judging them.
When does Overgeneralising from Small Samples matter?
Overgeneralising from Small Samples is one of the 68 mental models for evidence, the situations where you ask: Is this really true? Within that, it belongs to “When research goes wrong”, alongside Anecdotal Evidence, Data Dredging and Hasty Generalisation.
What is an example of Overgeneralising from Small Samples?
Two stories show it at work: The Mozart effect (1993–1998) and Segway (2001). Both are told in full in The Mental Models Daily Almanac, which has two stories for each of its 365 models.
Which mental models are related to Overgeneralising from Small Samples?
Law of Large Numbers, Meta-Analysis and Optimism Bias. Overgeneralising from Small Samples itself comes from human nature and judgement.