Coaching practices for Calibrated Questions During a Big Change

Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Calibrated Questions During a Big Change, these are the strongest matches in the current practice library.

Does this sound like the set of challenges you might be facing?

• My real decisions take months to resolve and matter too much for me to score them honestly, so I never get clean reps
• I make calls about how things will go all the time, but I never write them down or check them after
• I walk into every test sure I’ll do well and walk out shocked by the score
• When I say I’m eighty percent sure I genuinely don’t know if that means anything
• I want to actually know whether my gut is any good — when I feel sure about something, am I right that often, or am I just confident?

Practices that may help

1. Calibrated Questions, Made Practical
   Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol.
2. Build calibration reps with low-stakes trivia and almanac questions
   Use factual trivia questions as a practice ground for calibration — outcomes resolve immediately and the stakes are zero.
   Calibration Training
3. Calibration Training
   Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
4. Score your own past predictions to calibrate your outside-view use
   Keep a forecast log and score it — you cannot improve calibration without feedback on where you were over- or under-confident.
   The Outside View
5. Confidence-accuracy gap tracking
   After each test, compute and record the gap between your predicted and actual scores.
   Feeling of Knowing: Why Your Confidence Misleads You
6. Practice calibration by tracking your confidence predictions
   Your "80% confident" beliefs should come true about 80% of the time — check that they do.
   Bayesian Thinking: How to Update Beliefs Rationally
7. Practice probability calibration
   Regularly make probabilistic predictions and track your accuracy across many of them.
   Hindsight Bias: Why Everything Seems Obvious in Retrospect
8. Decompose complex questions into sub-questions
   Break a hard forecasting question into smaller, estimable pieces and aggregate them.
   Superforecasting
9. Scale importance and confidence with the readiness ruler
   Ask “On a 0–10 scale, how ready are you?” — then ask why not lower.
   Motivational Interviewing, Made Practical
10. Design a personal question list that matches your current growth goals
    Build a short list of active questions that track the behaviors most relevant to your life right now — not a fixed template.
    The Morning Questions

Describe your situation in your own words to search the complete practice library.