Coaching practices for Finding Disconfirming Evidence
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Finding Disconfirming Evidence, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- Once I believe something, I only ever notice the things that prove me right
- I’m holding a belief tightly and I want to test it honestly, but I know that the second I go looking I’ll find whatever confirms it
- I keep saying things like "X always leads to Y" or "people like that never change," and I pile up examples that fit
- I notice I only go looking for the stuff that backs up what I already think, and it’s starting to bug me that I can’t even say what would prove me wrong
- A flimsy study that confirms what I want I’ll wave straight through, but a solid one that contradicts me I’ll pick apart for hours
Practices that may help
- Actively seek disconfirming evidence
Deliberately look for evidence that your current belief is wrong.
Superforecasting - Specify what would falsify your belief before you look at evidence
Write down what evidence would prove you wrong before you go looking.
Falsification Thinking - Search deliberately for the black swan
Look for the single example that would overturn your generalization.
Falsification Thinking - Actively seek evidence that would disconfirm your belief
Ask: "What would change my mind?" and then look for exactly that.
Bayesian Thinking: How to Update Beliefs Rationally - Apply the same evidence standard regardless of whether you like the conclusion
Grade the evidence before you know which conclusion it supports.
Motivated Reasoning - Actively seek information that disconfirms your view
Deliberately look for the best evidence against your current position before committing to it.
Naive Realism: Why Everyone Thinks They See Things as They Are - Actively seek evidence that would prove you wrong
Ask what would change your mind — and then look for it.
The Scout Mindset - Weigh disconfirming evidence more heavily than confirming evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Falsification Thinking - Consider the opposite
Actively argue the case against your first conclusion before accepting it.
Thinking, Fast and Slow, Made Usable - Examine the evidence for and against
Systematically list what supports your interpretation and what doesn’t — like a fair-minded lawyer, not a prosecutor.
Check the Facts, Made Practical
Related concerns
- Pre Specifying Disconfirming Evidence
Write down what evidence would prove you wrong before you go looking.
Specify what would falsify your belief before you look at evidence
- Disconfirming Evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Weigh disconfirming evidence more heavily than confirming evidence
- Seeking Contrary Evidence
Grade the evidence before you know which conclusion it supports.
Apply the same evidence standard regardless of whether you like the conclusion
- When Bayesian Thinking Kill Your Hypothesis
Ask: "What would change my mind?" and then look for exactly that.
Actively seek evidence that would disconfirm your belief
- When Bayesian Thinking Likelihood Ratio As Evidence Quality
Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
Evaluate evidence by its likelihood ratio, not by how it makes you feel
- When Falsification Thinking Asymmetric Evidence Weight
One strong counterexample outweighs many confirming examples for a universal claim.
Describe your situation in your own words to search the complete practice library.