Actively seek out the failures you aren’t seeing
Look for the people who tried the same thing and didn’t make it through.
Why it works
The defining feature of survivorship bias is that the missing data is invisible by design — failed businesses close, silent failures don’t publish, and losers generally don’t give keynotes. Reversing this requires deliberate effort to seek out the non-surviving cases: people who quit, companies that closed, strategies that didn’t work. The act of looking is itself the corrective, because the failures are there — they’re just not findable without a specific intention to find them.
How to do it
- For any domain where you’re drawing lessons from successful examples, explicitly ask: "Where would I find the failures in this category?"
- Search for post-mortems, failure case studies, and negative-result accounts.
- Find at least one concrete failure story before finalizing any lesson from a success story.
- Join communities where people discuss failures openly — these are often more useful than highlight-reel sources.
Evidence
The Wald aircraft case is the canonical illustration: the British air force was seeing only the planes that returned. Wald’s insight that the absence of bullet holes in certain areas was informative reversed the recommendation. This logic applies wherever a filter selects what you see. (mechanistic)
The logical principle is clear; how much bias reduction results from seeking failures in specific real-world contexts depends on how available and representative the failure data actually is.
Common mistake
Reading failure case studies as exceptions ("they made obvious mistakes") rather than as typical members of the full distribution. Failures often look obvious in retrospect due to hindsight bias, which compounds the error.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Survivorship Bias: Learning from What You Can’t See
- Ask for the failure rate before celebrating the success rate
Before drawing lessons from any success story, ask: out of how many attempts did this succeed?
- Choose the right reference class for any prediction
Find the statistical base rate for the category your decision belongs to — not just the inspiring examples.
- Audit whether your information sources systematically favor survivors
Check whether the media, advice, and communities you consume are filtered toward successes.
- Build a personal library of failure post-mortems
Deliberately collect, read, and learn from failure case studies in your domain.
- Steelman the strategy opposite to the successful one
Before adopting a lesson from a success story, build the best possible case for the opposite approach.
Related concepts
- Hindsight Bias: Why Everything Seems Obvious in Retrospect
How "I knew it all along" corrupts judgment — and the practices that correct it
- Thinking, Fast and Slow, Made Usable
Two systems, the biases they create, and when to slow down
- Decision Journaling: Learning to Decide Better Over Time
How to build a personal feedback loop for the decisions that actually matter