Coaching practices for I Keep Saying Things Like X Always Leads to Y or People Like That Never Change and I Pile Up Examples That Fit but I've Never Once Gone Hunting for the Single Case Where it Didn't Hold Even Though One Solid Exception Would Tell Me More Than a Hundred Confirmations
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For I Keep Saying Things Like X Always Leads to Y or People Like That Never Change and I Pile Up Examples That Fit but I've Never Once Gone Hunting for the Single Case Where it Didn't Hold Even Though One Solid Exception Would Tell Me More Than a Hundred Confirmations, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- I keep saying things like "X always leads to Y" or "people like that never change," and I pile up examples that fit
- Whenever a case pops up that contradicts what I believe, my reflex is to wave it away
- Once I believe something, I only ever notice the things that prove me right
- I only ever seem to run into facts that prove me right, and I’m starting to suspect that’s because I’m quietly steering toward them
- Once I’ve made up my mind, I notice I only ever see the evidence that proves me right and the rest just slides past me
Practices that may help
- Search deliberately for the black swan
Look for the single example that would overturn your generalization.
Falsification Thinking - Weigh disconfirming evidence more heavily than confirming evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Falsification Thinking - Actively seek disconfirming evidence
Deliberately look for evidence that your current belief is wrong.
Superforecasting - Actively seek evidence that would prove you wrong
Ask what would change your mind — and then look for it.
The Scout Mindset - Consider the opposite
Actively argue the case against your first conclusion before accepting it.
Thinking, Fast and Slow, Made Usable - Anchor on base rates before adding details
Start with how common the outcome is in the relevant population, then update — don’t start with the story.
The Conjunction Fallacy — When "More Details" Feels More Likely - Build a library of cases and reason from them
Accumulate a diverse set of cases with known outcomes, and retrieve structurally similar ones when facing a new problem.
Analogical Reasoning - Overgeneralization
Draw a sweeping conclusion from one or a few negative events.
Cognitive Distortions: The Thinking Errors Behind Anxiety and Depression - Actively seek information that disconfirms your view
Deliberately look for the best evidence against your current position before committing to it.
Naive Realism: Why Everyone Thinks They See Things as They Are - Examine the evidence for and against
Systematically list what supports your interpretation and what doesn’t — like a fair-minded lawyer, not a prosecutor.
Check the Facts, Made Practical
Related concerns
- Finding Disconfirming Evidence
Deliberately look for evidence that your current belief is wrong.
Actively seek disconfirming evidence
- When Falsification Thinking Asymmetric Evidence Weight
One strong counterexample outweighs many confirming examples for a universal claim.
Weigh disconfirming evidence more heavily than confirming evidence
- Pre Specifying Disconfirming Evidence
Write down what evidence would prove you wrong before you go looking.
Specify what would falsify your belief before you look at evidence
- Confirmation Bias Seeing What You Expect To See During Conflict
Confirmation bias is the tendency to seek, notice, and remember information that confirms existing beliefs, while ignoring or discounting contradictory evidence. It is among the most robustly documented cognitive biases. Debiasing is difficult and partial — knowing about it helps less than most people assume — but structured practices (actively seeking disconfirming evidence, pre-mortems, and adversarial collaboration) reliably reduce its impact.
- Debiasing Confirmation Bias
Confirmation bias is the tendency to seek, notice, and remember information that confirms existing beliefs, while ignoring or discounting contradictory evidence. It is among the most robustly documented cognitive biases. Debiasing is difficult and partial — knowing about it helps less than most people assume — but structured practices (actively seeking disconfirming evidence, pre-mortems, and adversarial collaboration) reliably reduce its impact.
- Disconfirming Example Search
Look for the single example that would overturn your generalization.
Search deliberately for the black swan
Describe your situation in your own words to search the complete practice library.