Coaching practices for Innovation Effort Calibration

Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Innovation Effort Calibration, these are the strongest matches in the current practice library.

Does this sound like the set of challenges you might be facing?

• I’ve been treating this like a problem nobody’s ever solved, pouring original effort into it
• I make calls about how things will go all the time, but I never write them down or check them after
• There’s one area I consider myself an expert in, and that’s exactly where I’m most stubbornly sure and most often wrong
• I have a cross-pollinated idea that might be brilliant or might be nonsense
• My reflex is always "just try harder, add more, set a stricter target," and I keep doing it even though the same problem comes back every time

Practices that may help

1. Calibrate whether the problem requires invention or just search
   Determine whether your problem is already solved elsewhere before investing in original invention.
   TRIZ: Systematic Invention and the Logic of Contradictions
2. Score your own past predictions to calibrate your outside-view use
   Keep a forecast log and score it — you cannot improve calibration without feedback on where you were over- or under-confident.
   The Outside View
3. Calibration Training
   Calibration training teaches you to match your stated confidence levels to your actual accuracy: if you say "70% confident," roughly 70% of those claims should turn out to be correct. Tetlock’s forecasting research and probability training studies show calibration is trainable with practice and feedback — the evidence here is specific and replicable.
4. Identify the specific domains where you are most overconfident
   Calibration is domain-specific — find where your confidence most exceeds your accuracy.
   Calibration Training
5. Run low-cost experiments on intersectional ideas
   Test cross-domain ideas quickly and cheaply before investing in them fully.
   The Medici Effect: Innovation at the Intersection
6. Resist the pull to optimize parameters when structure is the problem
   Notice when you are adjusting numbers and ask whether the structure is the actual problem.
   Leverage Points
7. Calibration practice
   Predict your performance before each retrieval test, then compare prediction to outcome.
   Self-Regulated Learning: Taking Control of How You Learn
8. Build calibration reps with low-stakes trivia and almanac questions
   Use factual trivia questions as a practice ground for calibration — outcomes resolve immediately and the stakes are zero.
   Calibration Training
9. Practice calibration by tracking your confidence predictions
   Your "80% confident" beliefs should come true about 80% of the time — check that they do.
   Bayesian Thinking: How to Update Beliefs Rationally
10. Run the smallest test that can answer the question
    Shrink your experiment so the feedback cycle is fast and the cost of being wrong is low.
    Plan–Do–Study–Act: Deming’s Loop for Personal Improvement

Describe your situation in your own words to search the complete practice library.