Separate the quality of the decision from the outcome
A good decision can produce a bad outcome, and a bad decision can produce a good outcome — do not confuse them.
Why it works
Resulting — judging a decision by its outcome rather than the quality of the reasoning — is the central error the framework addresses. Outcomes are partly luck; the decision is the only thing you controlled. Systematically grading yourself on outcomes rather than process trains the wrong skill and distorts how you update your decision-making going forward.
How to do it
- After any significant decision plays out, write a brief evaluation: "was the reasoning sound given what I knew at the time?"
- Evaluate that separately from: "did it work out?"
- Look for bad processes that worked (lucky) and good processes that failed (unlucky) and treat them accordingly.
- Resist congratulating yourself for a good outcome that came from poor reasoning.
Evidence
Resulting is well documented in hindsight bias research — people reconstruct decisions as obviously right or wrong based on outcome, obscuring the uncertainty that existed at decision time. The practice of process-based evaluation is recommended in forecasting and decision science but not itself studied in an RCT. (mechanistic)
Separating process from outcome is conceptually sound; doing it reliably in practice requires explicit record-keeping since hindsight bias operates automatically.
Sources
- Fischhoff (1975), hindsight bias and outcome knowledge, Journal of Experimental Psychology
Common mistake
Believing you can distinguish luck from skill retroactively without pre-commitment records — hindsight makes good luck look like skill and bad luck look like bad process.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Thinking in Bets
- Think in probabilities, not certainties
Replace "I think this will happen" with "I think there is a 70% chance this will happen."
- Run a premortem before committing
Imagine the decision has already failed — then ask why.
- Check the outside view before trusting the inside view
Ask how similar situations have gone before trusting your story about this specific situation.
- Update beliefs explicitly when new information arrives
Treat new information as a reason to state a revised probability, not as confirmation of the old one.
- Find a truth-seeking group that argues with you
Surround yourself with people whose job in the relationship is to challenge your reasoning, not validate it.
Related concepts
- Thinking, Fast and Slow, Made Usable
Two systems, the biases they create, and when to slow down
- Hanlon's Razor: Never Attribute to Malice What Stupidity Can Explain
The charitable-attribution heuristic and why it usually serves you better
- Circle of Competence
Know what you know, know what you do not know, and act accordingly
- Second-Order Thinking: And Then What?
Tracing consequences of consequences, the way Howard Marks does