Coaching practices for How to Avoid Scale Errors
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For How to Avoid Scale Errors, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- My answer came out wildly off and I can feel that it’s wrong but can’t spot where
- I read "thousands affected" and feel a pang, then "hundreds of thousands" and feel that exact same pang
- I make calls about how things will go all the time, but I never write them down or check them after
- I catch myself shaving down the estimate I’m about to present
- My guesses never seem to get any better because I make them, find out the real answer, and then just move on
Practices that may help
- Check units and scales for consistency
Catch order-of-magnitude errors by ensuring your units are consistent across the estimate.
Fermi Estimation - Translate scale into numbers before you respond
Before reacting to any quantity-based problem, convert the scale into a concrete number you can compare.
Scope Insensitivity: Why Scale Doesn’t Change Your Feelings - Score your own past predictions to calibrate your outside-view use
Keep a forecast log and score it — you cannot improve calibration without feedback on where you were over- or under-confident.
The Outside View - Scope Insensitivity: Why Scale Doesn’t Change Your Feelings
Scope insensitivity is the tendency to react with nearly the same emotional intensity to problems of vastly different scale — to care about 2,000 birds in danger nearly as much as 200,000 birds. Identified by Kahneman and colleagues, it is one of the clearest demonstrations that moral and decision-relevant emotions respond to the image of a problem, not its magnitude. The bias has strong empirical support and has important implications for charitable giving, risk assessment, and resource allocation. - Distinguish cognitive optimism bias from strategic misrepresentation
Recognize that some forecast inflation is genuine bias and some is deliberate spin — they require different fixes.
Reference Class Forecasting - Track your estimates and calibrate
Compare your Fermi estimates to actual figures when you can, and use the gap to improve future estimates.
Fermi Estimation - Treat forecasting accuracy as a skill that improves with practice
Take prediction errors as performance feedback, not as proof that forecasting is futile.
Superforecasting - Anchor on the base rate before adding inside-view details
Start your forecast from the class median, then adjust — do not start from your narrative and adjust to the base rate.
Reference Class Forecasting - Log actual vs. estimated time for every task
Build a personal database of your own estimation errors so you can calibrate future predictions.
The Planning Fallacy — Why Your Estimates Are Always Wrong - Build calibration reps with low-stakes trivia and almanac questions
Use factual trivia questions as a practice ground for calibration — outcomes resolve immediately and the stakes are zero.
Calibration Training
Related concerns
- Estimation Error Buffer
Test your estimate against the clearly too-high and too-low bounds to calibrate your range.
Sanity-check against known extremes
- Forecast Revision Practice
Treat your forecast as a probability that should shift with each new piece of evidence, not a commitment that survives contradiction.
Update your forecast incrementally as new evidence arrives
- How To Make Better Forecasts
Record actual vs. forecast outcomes honestly — this builds the reference class that future forecasts depend on.
Conduct post-project debriefs to contribute to the class data
- Magnitude Comparison Bias
Before reacting to any quantity-based problem, convert the scale into a concrete number you can compare.
Translate scale into numbers before you respond
- Appraisal Accuracy
If you think something is worth X, only commit at a meaningful discount to X.
Discount your estimate to create a margin
- Bottom Up Estimation
Estimate each sub-task independently, then add them up — the sum is closer to truth than a top-down estimate.
Decompose tasks and sum the pieces
Describe your situation in your own words to search the complete practice library.