Coaching practices for A Flimsy Study That Confirms What I Want I'll Wave Straight Through but a Solid One That Contradicts Me I'll Pick Apart for Hours I'm Clearly Holding Evidence to Totally Different Bars Depending on Whether I Like Where it Points
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For A Flimsy Study That Confirms What I Want I'll Wave Straight Through but a Solid One That Contradicts Me I'll Pick Apart for Hours I'm Clearly Holding Evidence to Totally Different Bars Depending on Whether I Like Where it Points, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- A flimsy study that confirms what I want I’ll wave straight through, but a solid one that contradicts me I’ll pick apart for hours
- Once I’ve made up my mind, I notice I only ever see the evidence that proves me right and the rest just slides past me
- I’m leaning hard on the evidence that lines up with what I want to be true and brushing off the rest
- I only ever seem to run into facts that prove me right, and I’m starting to suspect that’s because I’m quietly steering toward them
- Whenever a case pops up that contradicts what I believe, my reflex is to wave it away
Practices that may help
- Apply the same evidence standard regardless of whether you like the conclusion
Grade the evidence before you know which conclusion it supports.
Motivated Reasoning - Consider the opposite
Actively argue the case against your first conclusion before accepting it.
Thinking, Fast and Slow, Made Usable - Evaluate evidence by its likelihood ratio, not by how it makes you feel
Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
Bayesian Thinking: How to Update Beliefs Rationally - Actively seek evidence that would prove you wrong
Ask what would change your mind — and then look for it.
The Scout Mindset - Weigh disconfirming evidence more heavily than confirming evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Falsification Thinking - Specify what would falsify your belief before you look at evidence
Write down what evidence would prove you wrong before you go looking.
Falsification Thinking - Examine the evidence for and against
Systematically list what supports your interpretation and what doesn’t — like a fair-minded lawyer, not a prosecutor.
Check the Facts, Made Practical - Ask what alternative perspectives would say
Deliberately steelman the strongest objection to your current position before treating it as settled.
Socratic Questioning - Apply the double-standard check: would I accept this reasoning if it pointed the other way?
Test whether you are holding your team’s arguments to a lower bar than the other side’s.
The Scout Mindset - Rate the strength of each logical link
Assign a confidence to each "supports" or "rebuts" link, not just to the conclusion.
Argument Mapping
Related concerns
- Finding Disconfirming Evidence
Deliberately look for evidence that your current belief is wrong.
Actively seek disconfirming evidence
- When Bayesian Thinking Likelihood Ratio As Evidence Quality
Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
Evaluate evidence by its likelihood ratio, not by how it makes you feel
- When Cognitive Restructuring Examine The Evidence
Treat the thought as a hypothesis and find the actual evidence on both sides.
Examine the evidence for and against the thought
- Argument Strength Rating
Assign a confidence to each "supports" or "rebuts" link, not just to the conclusion.
Rate the strength of each logical link
- How To Evaluate Evidence Fairly
Grade the evidence before you know which conclusion it supports.
Apply the same evidence standard regardless of whether you like the conclusion
- Pre Specifying Disconfirming Evidence
Write down what evidence would prove you wrong before you go looking.
Specify what would falsify your belief before you look at evidence
Describe your situation in your own words to search the complete practice library.