Expect regression to the mean in extreme outcomes
Unusually good or bad performance tends to be followed by more average performance — not because of what you did.
Why it works
Regression to the mean is a mathematical property of any measured variable with random components: extreme high values are likely to be followed by lower values, and vice versa, simply because the extreme reading partly reflected a lucky draw. People systematically misattribute this regression to their own actions (the coach whose harsh criticism after a bad game appears to produce improvement) — Kahneman’s classic example of a mechanism that creates false causal beliefs.
How to do it
- When you observe an extreme performance (very good or very bad), ask: "How much of this might be random variation?"
- Resist attributing the subsequent regression to your intervention unless you have a controlled comparison.
- Use averages over time rather than single extreme readings as your benchmark.
Evidence
Regression to the mean is mathematically derived and documented in a wide range of applied settings from athletic performance to medical symptom progression. Kahneman documented the misattribution of regression effects in flight instructor training and elsewhere. (observational)
Sources
- Kahneman (2011), Thinking, Fast and Slow — regression to the mean and misattribution chapter
Common mistake
Concluding that a harsh response "worked" because performance improved after it — without controlling for the regression that would have occurred anyway.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Base-Rate Neglect: Why We Ignore the Odds
- Ask the base rate before evaluating the specific case
Before judging any individual instance, first establish how often this kind of thing happens in general.
- Use reference class forecasting for project estimates
Estimate how long similar projects have taken historically before estimating your specific project.
- Update beliefs by degrees, not wholesale
Treat new information as evidence that shifts probabilities, not as proof that changes everything.
- Always identify the denominator when evaluating risk or success
When a number or story is striking, ask: "Out of how many total cases?"
- Deliberately invoke the outside view for important decisions
For any high-stakes prediction, force yourself to start with how things typically go, not how your situation feels.
- Practice probabilistic calibration by tracking your predictions
Assign explicit probability estimates to your predictions and track whether they come true at the right rate.
Related concepts
- Thinking, Fast and Slow, Made Usable
Two systems, the biases they create, and when to slow down
- Bayesian Thinking: How to Update Beliefs Rationally
Holding beliefs as probabilities and updating them when evidence arrives
- Anchoring Bias in Negotiation and Judgment
Why the first number wins — the mechanism, and how to set and resist anchors