Coaching practices for Calibrated Thinking

Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Calibrated Thinking, these are the strongest matches in the current practice library.

Does this sound like the set of challenges you might be facing?

  • When I say I’m eighty percent sure I genuinely don’t know if that means anything
  • My real decisions take months to resolve and matter too much for me to score them honestly, so I never get clean reps
  • The thought just feels so obviously true that I accept it on the spot without ever checking it
  • I try to talk myself into the bright-side version
  • I make calls about how things will go all the time, but I never write them down or check them after

Practices that may help

  1. Calibration Training
    Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
  2. Practice calibration by tracking your confidence predictions
    Your "80% confident" beliefs should come true about 80% of the time — check that they do.
    Bayesian Thinking: How to Update Beliefs Rationally
  3. Calibrated Questions, Made Practical
    Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol.
  4. Build calibration reps with low-stakes trivia and almanac questions
    Use factual trivia questions as a practice ground for calibration — outcomes resolve immediately and the stakes are zero.
    Calibration Training
  5. Examine the evidence for and against
    Test the thought like a hypothesis: what actually supports it, and what argues against it?
    Cognitive Reframing, Made Practical
  6. Generate a balanced alternative thought
    Write a more accurate thought that incorporates all the evidence — not a positive spin, but the actual picture.
    The Thought Record: CBT’s Core Self-Examination Tool
  7. Score your own past predictions to calibrate your outside-view use
    Keep a forecast log and score it — you cannot improve calibration without feedback on where you were over- or under-confident.
    The Outside View
  8. Generate a balanced alternative
    Replace the distorted thought with one that is more accurate and still believable.
    Cognitive Reframing, Made Practical
  9. Name the cognitive distortion
    Match the thought to a known thinking trap — catastrophizing, mind-reading, all-or-nothing.
    Cognitive Reframing, Made Practical
  10. Identify the specific domains where you are most overconfident
    Calibration is domain-specific — find where your confidence most exceeds your accuracy.
    Calibration Training

Related concerns

Describe your situation in your own words to search the complete practice library.

Practice this with IX Coach

Try this practice