Apply the same evidence standard regardless of whether you like the conclusion
Grade the evidence before you know which conclusion it supports.
Why it works
One of Kunda’s clearest findings is asymmetric evidence evaluation: people demand high-quality evidence for unwelcome conclusions and accept weaker evidence for welcome ones. Applying a consistent quality standard — ideally assessing the evidence before mapping it to a conclusion — removes this asymmetry. The mechanism is simple: you cannot selectively accept weak evidence for your favored conclusion if you rated that evidence quality before checking which side it lands on.
How to do it
- When evaluating sources or arguments, rate their quality before you check which conclusion they support.
- Ask: "How would I rate this study/argument if I did not know which conclusion it led to?"
- Apply the same criteria — sample size, methodology, publication quality — symmetrically to evidence on both sides.
Evidence
Differential evidence standards are a well-documented feature of motivated reasoning. Blind review procedures in science (evaluating methodology before knowing results) demonstrate that consistent standards improve objectivity. (observational)
Pre-evaluating evidence quality before knowing the conclusion is easier to describe than to execute; in practice, the conclusion is often implied by the source or framing.
Sources
- Kunda (1990), Psychological Bulletin — differential scrutiny as a motivated reasoning mechanism
Common mistake
Applying the standard retrospectively after the conclusion is already emotionally registered, at which point the standard itself is motivated.
Practice this with IX Coach
IX Coach presents evidence and asks you to rate its quality and relevance before revealing which conclusion it most supports, training the consistent-standards habit as a practiced skill.
7 days free, then $40/month (~$1.30/day).