Coaching practices for Asymmetric Evidence Standards

Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Asymmetric Evidence Standards, these are the strongest matches in the current practice library.

Does this sound like the set of challenges you might be facing?

• A flimsy study that confirms what I want I’ll wave straight through, but a solid one that contradicts me I’ll pick apart for hours
• I wave through arguments on my side that I’d tear apart in a heartbeat if the other side made them
• I’m leaning hard on the evidence that lines up with what I want to be true and brushing off the rest
• The story hangs together so neatly
• Someone stated something with total confidence and I just nodded and built on it

Practices that may help

1. Apply the same evidence standard regardless of whether you like the conclusion
   Grade the evidence before you know which conclusion it supports.
   Motivated Reasoning
2. Apply the double-standard check: would I accept this reasoning if it pointed the other way?
   Test whether you are holding your team’s arguments to a lower bar than the other side’s.
   The Scout Mindset
3. Evaluate evidence by its likelihood ratio, not by how it makes you feel
   Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
   Bayesian Thinking: How to Update Beliefs Rationally
4. Identify which features are actually diagnostic
   Separate features that genuinely differentiate categories from ones that just complete the picture.
   The Representativeness Heuristic — Judging by Resemblance
5. Probe for evidence behind claims
   Ask "what evidence supports that?" before accepting any factual or evaluative claim.
   Socratic Questioning
6. Check whether you’re demanding an unfair ambiguity premium
   Estimate what you’d accept under comparable known-odds risk — if your bar is much higher for unknown odds, that gap is the bias.
   Ambiguity Aversion — Why Unknown Odds Feel Worse Than Bad Odds
7. Weigh disconfirming evidence more heavily than confirming evidence
   One strong counterexample outweighs many confirming examples for a universal claim.
   Falsification Thinking
8. Actively seek information that disconfirms your view
   Deliberately look for the best evidence against your current position before committing to it.
   Naive Realism: Why Everyone Thinks They See Things as They Are
9. Separate steelmanning from endorsing
   Accurately represent a view without implying you agree with it.
   Steelmanning
10. Update beliefs incrementally, not all at once
    New evidence should shift your probability somewhat — rarely from 5% to 95% in one step.
    Bayesian Thinking: How to Update Beliefs Rationally

Describe your situation in your own words to search the complete practice library.