Review past beliefs for what evidence did and didn’t move them

Look back at past beliefs and ask: what would have changed my mind then, and did I let it?

Why it works

Retrospective review creates a track record that reveals whether your reasoning process has actually been falsifiable in practice. If you can identify beliefs you once held that have since been falsified — and you can trace what evidence moved you — that is evidence that your belief-formation is connected to reality. If no belief has ever been falsified despite considerable time and evidence, that is a warning sign about the quality of the updating process.

How to do it

1. Choose a belief you held 1–2 years ago that has since changed.
2. Identify what evidence or argument actually moved you.
3. Ask: was there evidence available earlier that I should have been moved by, but wasn’t?
4. Use the answer to calibrate your current beliefs: am I letting current evidence move me?

Evidence

Prospective belief tracking and retrospective calibration review are standard tools in structured forecasting (Good Judgment Project, prediction markets). Participants who review past forecasts update more accurately on future ones. (observational)

Memory for past beliefs is reconstructive and systematically biased toward current views (hindsight bias), which makes retrospective review less reliable without written records.

Sources

• Tetlock & Gardner (2015), Superforecasting — feedback and calibration review as drivers of accuracy

Common mistake

Reconstructing past beliefs to match what you currently believe and then concluding you have always been consistent — hindsight bias makes the falsification appear to have been easier to see in advance than it was.