Apply the same evidence standard regardless of whether you like the conclusion
Grade the evidence before you know which conclusion it supports.
Why it works
One of Kunda’s clearest findings is asymmetric evidence evaluation: people demand high-quality evidence for unwelcome conclusions and accept weaker evidence for welcome ones. Applying a consistent quality standard — ideally assessing the evidence before mapping it to a conclusion — removes this asymmetry. The mechanism is simple: you cannot selectively accept weak evidence for your favored conclusion if you rated that evidence quality before checking which side it lands on.
How to do it
- When evaluating sources or arguments, rate their quality before you check which conclusion they support.
- Ask: "How would I rate this study/argument if I did not know which conclusion it led to?"
- Apply the same criteria — sample size, methodology, publication quality — symmetrically to evidence on both sides.
Evidence
Differential evidence standards are a well-documented feature of motivated reasoning. Blind review procedures in science (evaluating methodology before knowing results) demonstrate that consistent standards improve objectivity. (observational)
Pre-evaluating evidence quality before knowing the conclusion is easier to describe than to execute; in practice, the conclusion is often implied by the source or framing.
Sources
- Kunda (1990), Psychological Bulletin — differential scrutiny as a motivated reasoning mechanism
Common mistake
Applying the standard retrospectively after the conclusion is already emotionally registered, at which point the standard itself is motivated.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Motivated Reasoning
- Distinguish directional from accuracy goals before you start
Before reasoning about something, ask whether you are trying to reach a specific answer or the correct one.
- Consider the opposite before finalizing a judgment
Deliberately generate the case for the conclusion you are not reaching.
- Set the constraint: what conclusions would you not accept?
Pre-define which conclusions would be embarrassing, then monitor whether your reasoning is steering away from them.
- Catch yourself working backward from a conclusion
Notice when the conclusion appeared before the evidence — and treat that as a red flag.
- Apply extra scrutiny to conclusions you like
Treat agreement that feels effortless as a signal to double-check, not a signal to stop.
Related concepts
- The Scout Mindset
Wanting to see clearly, not to be right — and the habits that make it real
- Productive Disagreement, Made Practical
How to argue better, think more clearly together, and update without losing face
- Falsification Thinking
Test your beliefs the way scientists test hypotheses — by trying to break them
- Cognitive Reframing, Made Practical
How reappraisal changes emotion, the common distortions, and how to do it without toxic positivity