Weigh disconfirming evidence more heavily than confirming evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Why it works
Popper’s insight is that the logical relation between evidence and hypothesis is asymmetric: modus tollens (if A then B; not-B; therefore not-A) is valid, but induction (many B’s observed; therefore always B) is not. In practice, this means a single, well-documented exception to a rule deserves more evidential weight than ten consistent examples — because the exception could definitively falsify the rule while the examples cannot definitively confirm it.
How to do it
- When evaluating evidence for a rule or generalization, actively look for documented exceptions.
- When you find one, ask: "Does this exception require abandoning the rule or narrowing it?"
- Weight your update to the exception more than proportionally — ask what universe of cases the exception reveals.
Evidence
The logical asymmetry between falsification and confirmation (the problem of induction) is well established in philosophy of science since Hume. Bayesian reasoning formalizes this partially: a surprising disconfirmation typically yields a larger update than an expected confirmation. (mechanistic)
In practice, single exceptions are often measurement error rather than genuine counterexamples; careful judgment about exception quality is required before drawing large updates.
Sources
- Popper (1959), The Logic of Scientific Discovery — asymmetry of falsification and confirmation
Common mistake
Dismissing every exception as "an outlier" or "a special case" — this is an unfalsifiable move that immunizes the belief against any possible correction.
Practice this with IX Coach
IX Coach flags exceptions to your working assumptions and asks you to engage with rather than dismiss them, preventing the reflexive "that doesn’t count" response.
7 days free, then $40/month (~$1.30/day).