Coaching practices for Asymmetric Evidence

Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Asymmetric Evidence, these are the strongest matches in the current practice library.

Does this sound like the set of challenges you might be facing?

• A flimsy study that confirms what I want I’ll wave straight through, but a solid one that contradicts me I’ll pick apart for hours
• I’m leaning hard on the evidence that lines up with what I want to be true and brushing off the rest
• I wave through arguments on my side that I’d tear apart in a heartbeat if the other side made them
• Everything I read and everyone I ask keeps confirming what I already believe, and it’s starting to feel too clean
• Nobody around me will actually push back

Practices that may help

1. Apply the same evidence standard regardless of whether you like the conclusion
   Grade the evidence before you know which conclusion it supports.
   Motivated Reasoning
2. Evaluate evidence by its likelihood ratio, not by how it makes you feel
   Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
   Bayesian Thinking: How to Update Beliefs Rationally
3. Apply the double-standard check: would I accept this reasoning if it pointed the other way?
   Test whether you are holding your team’s arguments to a lower bar than the other side’s.
   The Scout Mindset
4. Actively seek information that disconfirms your view
   Deliberately look for the best evidence against your current position before committing to it.
   Naive Realism: Why Everyone Thinks They See Things as They Are
5. Invite an adversarial collaborator
   Find someone whose genuine prior is the opposite of yours, and work together on the same evidence.
   Confirmation Bias: Seeing What You Expect to See
6. Weigh disconfirming evidence more heavily than confirming evidence
   One strong counterexample outweighs many confirming examples for a universal claim.
   Falsification Thinking
7. Identify which features are actually diagnostic
   Separate features that genuinely differentiate categories from ones that just complete the picture.
   The Representativeness Heuristic — Judging by Resemblance
8. Testing a core belief with historical evidence
   Once you have a core belief, survey all your history for evidence that contradicts it.
   The Downward Arrow: Uncovering the Core Beliefs Behind Distress
9. Deliberately consider the opposite hypothesis
   For any belief you are testing, explicitly generate the strongest case for the opposing view.
   Confirmation Bias: Seeing What You Expect to See
10. Check whether you’re demanding an unfair ambiguity premium
    Estimate what you’d accept under comparable known-odds risk — if your bar is much higher for unknown odds, that gap is the bias.
    Ambiguity Aversion — Why Unknown Odds Feel Worse Than Bad Odds

Describe your situation in your own words to search the complete practice library.