Coaching practices for Calibrated Questions After a Loss

Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Calibrated Questions After a Loss, these are the strongest matches in the current practice library.

Does this sound like the set of challenges you might be facing?

• My real decisions take months to resolve and matter too much for me to score them honestly, so I never get clean reps
• Every time something goes sideways we replay it looking for who dropped the ball, and the wins we never examine at all
• I walk into every test sure I’ll do well and walk out shocked by the score
• I make calls all the time but I never write them down or check them later, so my confidence is just a feeling that floats free
• I make calls about how things will go all the time, but I never write them down or check them after

Practices that may help

1. Calibrated Questions, Made Practical
   Calibrated questions are open "How" and "What" questions that hand the other party a problem to solve, letting you steer a negotiation or difficult conversation without commands or ultimatums. The technique comes from Chris Voss’s FBI hostage-negotiation work; its mechanism is grounded in autonomy psychology, though the specific scripts are practitioner craft rather than a lab-validated protocol.
2. Build calibration reps with low-stakes trivia and almanac questions
   Use factual trivia questions as a practice ground for calibration — outcomes resolve immediately and the stakes are zero.
   Calibration Training
3. Calibration Training
   Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
4. Run brief after-action reviews without blame
   After any significant outcome — success or failure — ask four questions together as a team.
   Psychological Safety in Teams
5. Confidence-accuracy gap tracking
   After each test, compute and record the gap between your predicted and actual scores.
   Feeling of Knowing: Why Your Confidence Misleads You
6. Maintain a scored prediction log
   Record predictions with explicit probabilities and score them when they resolve.
   Calibration Training
7. Score your own past predictions to calibrate your outside-view use
   Keep a forecast log and score it — you cannot improve calibration without feedback on where you were over- or under-confident.
   The Outside View
8. Replace "why" with "how" or "what"
   "Why" sounds accusatory; "how" and "what" invite problem-solving.
   Calibrated Questions, Made Practical
9. Practice probability calibration
   Regularly make probabilistic predictions and track your accuracy across many of them.
   Hindsight Bias: Why Everything Seems Obvious in Retrospect
10. Set the reference point before you introduce the loss
    Loss is always measured from a reference point — who sets that point controls the framing.
    The Loss Frame: How Framing Shapes Decisions

Describe your situation in your own words to search the complete practice library.