Steelman the strategy opposite to the successful one
Before adopting a lesson from a success story, build the best possible case for the opposite approach.
Why it works
When survivorship bias has already selected your examples, reasoning within the frame of those examples compounds the bias. Requiring yourself to build a genuine case for the opposite strategy — not a strawman, but the strongest possible version — forces you out of the frame and confronts the selection filter directly. If you can’t construct a plausible case for the opposite, the lesson may be real; if you can, you’ve found where survivorship bias was doing the work.
How to do it
- Take a lesson you’ve drawn from a success story (e.g., "the key was focus on a niche market").
- Write the strongest possible argument for the opposite strategy (e.g., "the key is actually broad market appeal").
- Find real examples that support the opposite.
- If both approaches have real successes, you’re looking at a survivorship-bias artifact, not a reliable lesson.
Evidence
Steelmanning — constructing the strongest version of an opposing argument — is a tool from critical thinking practice. It directly operationalizes considering the full hypothesis space rather than the survivor-selected subset. (mechanistic)
Steelmanning is a reasoning discipline, not a studied intervention; its effectiveness depends on whether the person can genuinely construct the opposing case rather than a weakened version of it.
Common mistake
Constructing a weak version of the opposite argument (a strawman) and then dismissing it easily, which confirms rather than challenges the original bias.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Survivorship Bias: Learning from What You Can’t See
- Ask for the failure rate before celebrating the success rate
Before drawing lessons from any success story, ask: out of how many attempts did this succeed?
- Actively seek out the failures you aren’t seeing
Look for the people who tried the same thing and didn’t make it through.
- Choose the right reference class for any prediction
Find the statistical base rate for the category your decision belongs to — not just the inspiring examples.
- Audit whether your information sources systematically favor survivors
Check whether the media, advice, and communities you consume are filtered toward successes.
- Build a personal library of failure post-mortems
Deliberately collect, read, and learn from failure case studies in your domain.
Related concepts
- Hindsight Bias: Why Everything Seems Obvious in Retrospect
How "I knew it all along" corrupts judgment — and the practices that correct it
- Thinking, Fast and Slow, Made Usable
Two systems, the biases they create, and when to slow down
- Decision Journaling: Learning to Decide Better Over Time
How to build a personal feedback loop for the decisions that actually matter