Actively seek evidence that would disconfirm your belief
Ask: "What would change my mind?" and then look for exactly that.
Why it works
Confirmation bias causes people to search for, notice, and remember evidence consistent with existing beliefs and to ignore, forget, or discount contradictory evidence. The Bayesian antidote is deliberate disconfirmation search: actively seeking the evidence that would be most likely in the hypothesis-false world. This is cognitively uncomfortable precisely because it works.
How to do it
- State your current belief explicitly.
- Ask: "What single piece of evidence, if I found it, would make this belief clearly wrong?"
- Go look for that evidence deliberately, not incidentally.
- If you cannot find any such evidence or cannot imagine what it would look like, treat that as a warning sign that the belief is unfalsifiable.
Evidence
Confirmation bias is among the most robustly documented cognitive biases. Deliberate disconfirmation strategies have shown some evidence of reducing it in laboratory tasks, though real-world debiasing is difficult and often only partially successful. (observational)
Debiasing interventions for confirmation bias produce modest and often context-limited effects; the practice helps but does not eliminate the bias.
Sources
- Wason (1960), failure to falsify in a reasoning task, Quarterly Journal of Experimental Psychology
- Nickerson (1998), confirmation bias: a ubiquitous phenomenon, Review of General Psychology
Common mistake
Generating a hypothetical "what would change my mind" answer but never actually searching for that evidence — the exercise stays verbal rather than becoming an empirical act.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Bayesian Thinking: How to Update Beliefs Rationally
- State your prior probability before seeing the evidence
Before looking at any data, commit to a numerical estimate of how likely something is.
- Update beliefs incrementally, not all at once
New evidence should shift your probability somewhat — rarely from 5% to 95% in one step.
- Evaluate evidence by its likelihood ratio, not by how it makes you feel
Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
- Practice calibration by tracking your confidence predictions
Your "80% confident" beliefs should come true about 80% of the time — check that they do.
- Use reference classes to ground personal estimates in base rates
Before estimating how your situation will unfold, find similar past situations and check what happened.
- Translate beliefs into bets to reveal your true confidence
Would you bet $100 on that belief at even odds? The answer often reveals the gap between claimed and actual confidence.
Related concepts
- Thinking, Fast and Slow, Made Usable
Two systems, the biases they create, and when to slow down
- Mental Models: Charlie Munger’s Latticework Approach
Building the multi-disciplinary toolkit that lets you see what single-discipline thinkers miss
- Confirmation Bias: Seeing What You Expect to See
The most pervasive cognitive bias and the practices that actually chip away at it
- Expected Value Thinking: Deciding Under Uncertainty
The math of rational choice under uncertainty, its real limits, and how to use it anyway