Maintain a belief-tracking log with timestamps
Record your beliefs and confidence levels before evidence arrives, so you can see whether you actually updated.
Why it works
Confirmation bias affects not just new information intake but memory: people misremember their prior beliefs to be more consistent with current beliefs, making it feel like they updated when they barely moved. A timestamped written record is the only reliable check: if the written prior belief and the post-evidence belief differ, the difference is real; if they don’t differ, neither did you.
How to do it
- For any significant belief or prediction, write it down with a date and a confidence level (e.g., 75%).
- When relevant evidence arrives, write your new confidence level before reading anyone else’s analysis.
- Periodically review old entries and compute your actual update size.
- Track whether your updates are systematically small (anchoring/conservatism) or systematically large (overreaction).
Evidence
Memory for prior beliefs is demonstrably distorted by current beliefs — people reconstruct their past views to be more consistent with what they now believe. Pezzo (2003) and others document this hindsight bias effect, which the written record directly prevents. (observational)
A belief log requires honest recording; if beliefs are recorded post-hoc rather than pre-evidence, it reproduces the bias it was meant to prevent.
Sources
- Fischhoff (1975), hindsight ≠ foresight, Journal of Experimental Psychology: Human Perception and Performance
Common mistake
Writing beliefs at a granularity too coarse to detect real updating ("I thought this was likely" → "I think this is likely") — use numbers to capture what words obscure.
Practice this with IX Coach
IX Coach logs your stated beliefs with timestamps and resurfaces them when new relevant evidence appears, creating a permanent before-and-after record that cannot be reconstructed retroactively.
7 days free, then $40/month (~$1.30/day).