Coaching practices for Calibrated Thinking
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Calibrated Thinking, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- When I say I’m eighty percent sure I genuinely don’t know if that means anything
- My real decisions take months to resolve and matter too much for me to score them honestly, so I never get clean reps
- The thought just feels so obviously true that I accept it on the spot without ever checking it
- I try to talk myself into the bright-side version
- I make calls about how things will go all the time, but I never write them down or check them after
Practices that may help
- Calibration Training
Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable. - Practice calibration by tracking your confidence predictions
Your "80% confident" beliefs should come true about 80% of the time — check that they do.
Bayesian Thinking: How to Update Beliefs Rationally - Calibrated Questions, Made Practical
Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol. - Build calibration reps with low-stakes trivia and almanac questions
Use factual trivia questions as a practice ground for calibration — outcomes resolve immediately and the stakes are zero.
Calibration Training - Examine the evidence for and against
Test the thought like a hypothesis: what actually supports it, and what argues against it?
Cognitive Reframing, Made Practical - Generate a balanced alternative thought
Write a more accurate thought that incorporates all the evidence — not a positive spin, but the actual picture.
The Thought Record: CBT’s Core Self-Examination Tool - Score your own past predictions to calibrate your outside-view use
Keep a forecast log and score it — you cannot improve calibration without feedback on where you were over- or under-confident.
The Outside View - Generate a balanced alternative
Replace the distorted thought with one that is more accurate and still believable.
Cognitive Reframing, Made Practical - Name the cognitive distortion
Match the thought to a known thinking trap — catastrophizing, mind-reading, all-or-nothing.
Cognitive Reframing, Made Practical - Identify the specific domains where you are most overconfident
Calibration is domain-specific — find where your confidence most exceeds your accuracy.
Calibration Training
Related concerns
- Calibrated Beliefs
Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
- Calibrated Questions
Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol.
- Calibrated Questions At Work
Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol.
- Calibrated Questions With My Team
Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol.
- Calibration By Domain
Calibration is domain-specific — find where your confidence most exceeds your accuracy.
Identify the specific domains where you are most overconfident
- Calibration Control Classification
Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
Describe your situation in your own words to search the complete practice library.