Coaching practices for Seeking Contrary Evidence
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Seeking Contrary Evidence, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- A flimsy study that confirms what I want I’ll wave straight through, but a solid one that contradicts me I’ll pick apart for hours
- Nobody around me will actually push back
- Once I believe something, I only ever notice the things that prove me right
- I’m about to lock in a judgment and I’m only seeing the evidence that backs it
- I notice I only go looking for the stuff that backs up what I already think, and it’s starting to bug me that I can’t even say what would prove me wrong
Practices that may help
- Apply the same evidence standard regardless of whether you like the conclusion
Grade the evidence before you know which conclusion it supports.
Motivated Reasoning - Invite an adversarial collaborator
Find someone whose genuine prior is the opposite of yours, and work together on the same evidence.
Confirmation Bias: Seeing What You Expect to See - Actively seek disconfirming evidence
Deliberately look for evidence that your current belief is wrong.
Superforecasting - Consider the opposite before finalizing a judgment
Deliberately generate the case for the conclusion you are not reaching.
Motivated Reasoning - Actively seek evidence that would disconfirm your belief
Ask: "What would change my mind?" and then look for exactly that.
Bayesian Thinking: How to Update Beliefs Rationally - Consider the opposite
Actively argue the case against your first conclusion before accepting it.
Thinking, Fast and Slow, Made Usable - Weigh disconfirming evidence more heavily than confirming evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Falsification Thinking - Examine the evidence for and against
Systematically list what supports your interpretation and what doesn’t — like a fair-minded lawyer, not a prosecutor.
Check the Facts, Made Practical - Actively seek information that disconfirms your view
Deliberately look for the best evidence against your current position before committing to it.
Naive Realism: Why Everyone Thinks They See Things as They Are - Deliberately consider the opposite hypothesis
For any belief you are testing, explicitly generate the strongest case for the opposing view.
Confirmation Bias: Seeing What You Expect to See
Related concerns
- Debiasing Confirmation Bias
Confirmation bias is the tendency to seek, notice, and remember information that confirms existing beliefs, while ignoring or discounting contradictory evidence. It is among the most robustly documented cognitive biases. Debiasing is difficult and partial — knowing about it helps less than most people assume — but structured practices (actively seeking disconfirming evidence, pre-mortems, and adversarial collaboration) reliably reduce its impact.
- Finding Disconfirming Evidence
Deliberately look for evidence that your current belief is wrong.
Actively seek disconfirming evidence
- When Motivated Reasoning Consider The Opposite
Deliberately generate the case for the conclusion you are not reaching.
Consider the opposite before finalizing a judgment
- When Thinking Fast And Slow Consider The Opposite
Actively argue the case against your first conclusion before accepting it.
Consider the opposite
- Confirmation Bias Seeing What You Expect To See During Conflict
Confirmation bias is the tendency to seek, notice, and remember information that confirms existing beliefs, while ignoring or discounting contradictory evidence. It is among the most robustly documented cognitive biases. Debiasing is difficult and partial — knowing about it helps less than most people assume — but structured practices (actively seeking disconfirming evidence, pre-mortems, and adversarial collaboration) reliably reduce its impact.
- Disconfirming Evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Weigh disconfirming evidence more heavily than confirming evidence
Describe your situation in your own words to search the complete practice library.