Update your forecast incrementally as new evidence arrives
Treat your forecast as a probability that should shift with each new piece of evidence, not a commitment that survives contradiction.
Why it works
Forecasts that are not updated in response to evidence are not forecasts — they are commitments in disguise. The updating mechanism is Bayesian: new evidence shifts the probability, with the magnitude of the shift proportional to the evidence’s diagnostic value. The failure mode is updating too slowly (anchoring on the original estimate) or updating too violently (overweighting recent salient events).
How to do it
- Set a scheduled check-in cadence for significant forecasts — weekly for short-horizon, monthly for long-horizon.
- At each check-in, ask: "What evidence arrived since last time, and in which direction does it push?"
- Make a numerical update (even if small) so the record shows a decision to hold or move.
- Track your updating patterns over time — systematic under-updating or over-updating are diagnostic.
Evidence
Tetlock’s forecasting tournament research found that superforecasters update their predictions more frequently and in smaller increments than average forecasters, and maintain calibration over time as a result. Bayesian updating is the formal framework underlying this behavior. (observational)
In practice, people update more readily when evidence confirms their existing view. Disciplined Bayesian updating requires resisting this confirmation asymmetry, which is a sustained behavioral commitment, not a one-time technique.
Sources
- Tetlock & Gardner (2015), Superforecasting
- Tetlock (2005), Expert Political Judgment
Common mistake
Updating the narrative ("the situation has changed") but not the probability estimate, so there is no legible record of whether the updating was appropriately calibrated.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Reference Class Forecasting
- Identify the right reference class for your situation
Find a well-defined set of past situations that are structurally similar to yours and collect their outcome data.
- Anchor on the base rate before adding inside-view details
Start your forecast from the class median, then adjust — do not start from your narrative and adjust to the base rate.
- Forecast a distribution, not a point estimate
Represent your forecast as a range of likely outcomes, not a single predicted number.
- Distinguish cognitive optimism bias from strategic misrepresentation
Recognize that some forecast inflation is genuine bias and some is deliberate spin — they require different fixes.
- Conduct post-project debriefs to contribute to the class data
Record actual vs. forecast outcomes honestly — this builds the reference class that future forecasts depend on.