Ask for the failure rate before celebrating the success rate

Before drawing lessons from any success story, ask: out of how many attempts did this succeed?

Why it works

Any strategy, regardless of how random, will produce vivid successes among a large enough pool of attempts. The success itself tells you very little about the quality of the strategy — you need the denominator (how many tried) to compute the actual probability. Without the failure rate, your brain is pattern-matching on selected survivors, not on representative outcomes.

How to do it

1. When you encounter any success story or case study, ask: "How many people or businesses tried this same approach?"
2. Try to find the failure rate or base rate for that category.
3. If the failure rate is unavailable, hold the lesson with explicit uncertainty rather than treating it as a reliable lesson.
4. In your own decisions, log attempts and failures alongside successes so you have your own base rate.

Evidence

The failure-rate question is the direct debiasing move for survivorship bias. Base-rate neglect — ignoring background frequencies — is one of the most robust findings in the judgment-under-uncertainty literature. Forcing explicit consideration of base rates significantly improves probabilistic reasoning. (observational)

Knowing the base rate improves reasoning in tasks where the base rate is provided. In real-world settings, the failure-rate data is often genuinely unavailable, and even when available, people anchor to the vivid case rather than the statistic.

Sources

• Kahneman & Tversky (1973), "On the Psychology of Prediction", Psychological Review — base-rate neglect

Common mistake

Assuming that if the success story exists the strategy is worth emulating, without asking how representative that story is. Celebrity biographies and business case studies are almost entirely drawn from survivors.