No. 242 · Evidence · Statistics and Probability

False Positive

An alarm is a question, not an answer.


A false positive, or Type One error, happens when a test or judgment flags something that is not actually present. Because we act on alarms, false positives lead to needless panic, treatment or accusation, and at large scale even small error rates create many wrong alarms.

To use it, treat an alarm as a question, not an answer. Seek independent confirmation before acting, especially when people could be harmed, and tune your alerts so the important ones still get noticed.


In the Almanac

“NORAD’s training tape”, 1979 · “Rite Aid”, 2023

Both stories in full, three ways to use it and where it misleads.

Get the Almanac

Listen · Watch

False Positive

Questions

What is False Positive?

A false positive, or Type One error, happens when a test or judgment flags something that is not actually present. Because we act on alarms, false positives lead to needless panic, treatment or accusation, and at large scale even small error rates create many wrong alarms.

How do you use False Positive?

To use it, treat an alarm as a question, not an answer. Seek independent confirmation before acting, especially when people could be harmed, and tune your alerts so the important ones still get noticed.

When does False Positive matter?

False Positive is one of the 68 mental models for evidence, the situations where you ask: Is this really true? Within that, it belongs to “Testing a claim”, alongside False Negative, Falsification and Hypothesis.

What is an example of False Positive?

Two stories show it at work: NORAD’s training tape (1979) and Rite Aid (2023). Both are told in full in The Mental Models Daily Almanac, which has two stories for each of its 365 models.

Which mental models are related to False Positive?

False Negative, Base Rate Fallacy and Tit for Tat. False Positive itself comes from statistics and probability.