Coaching practices for Base Rate Confidence
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Base Rate Confidence, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- My confidence comes straight from how good a story I can tell myself about this particular case, and the more vivid the story the surer I get
- I’m sure about things constantly and I have no idea if that confidence is earned
- When I’d swear I know roughly where a number lands, the real answer is constantly outside the range I’d have bet on
- I make calls all the time but I never write them down or check them later, so my confidence is just a feeling that floats free
- When I say I’m eighty percent sure I genuinely don’t know if that means anything
Practices that may help
- Anchor your confidence level on base rates, not gut feel
Start your confidence estimate from the historical hit rate for this type of prediction, not from how confident you feel.
Calibration Training - Practice probabilistic calibration by tracking your predictions
Assign explicit probability estimates to your predictions and track whether they come true at the right rate.
Base-Rate Neglect: Why We Ignore the Odds - Base-Rate Neglect: Why We Ignore the Odds
Base-rate neglect is the tendency to underweight or ignore prior probabilities (how often things happen in general) when vivid, specific information is available. Identified by Kahneman and Tversky, it is one of the most robustly replicated biases in judgment research, and it leads to systematic overconfidence in predictions about specific cases. Correcting it requires actively looking up or estimating base rates before evaluating individual information. - Practice confidence interval estimation
Estimate ranges for factual quantities and check how often the true value falls within your range.
Calibration Training - Maintain a scored prediction log
Record predictions with explicit probabilities and score them when they resolve.
Calibration Training - Practice calibration by tracking your confidence predictions
Your "80% confident" beliefs should come true about 80% of the time — check that they do.
Bayesian Thinking: How to Update Beliefs Rationally - Anchor on the base rate before adding inside-view details
Start your forecast from the class median, then adjust — do not start from your narrative and adjust to the base rate.
Reference Class Forecasting - Distinguish uncertainty (quantifiable) from ignorance (unquantifiable)
Know when you can assign a probability and when the situation is so novel that a number would be fabricated.
Calibration Training - Forecast a distribution, not a point estimate
Represent your forecast as a range of likely outcomes, not a single predicted number.
Reference Class Forecasting - Estimate in ranges, not point estimates
Instead of "my estimate is 500," say "I think it is between 200 and 2000."
Fermi Estimation
Related concerns
- Confidence Intervals Estimation
Estimate ranges for factual quantities and check how often the true value falls within your range.
Practice confidence interval estimation
- Stable Confidence Base
Start your confidence estimate from the historical hit rate for this type of prediction, not from how confident you feel.
Anchor your confidence level on base rates, not gut feel
- Calibrated Confidence
Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
- Calibrated Uncertainty Ranges
Estimate ranges for factual quantities and check how often the true value falls within your range.
- Confidence Interval Training
Estimate ranges for factual quantities and check how often the true value falls within your range.
- How To Improve Confidence Estimates
Start your confidence estimate from the historical hit rate for this type of prediction, not from how confident you feel.
Describe your situation in your own words to search the complete practice library.