Coaching practices for Overfitting Reasoning
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Overfitting Reasoning, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- My theory about why this keeps happening has grown so many moving parts that it explains every little quirk perfectly
- When two things fit together neatly in my head, I treat the whole package as more likely than either piece alone
- The story hangs together so neatly
- There are a couple of answers here that would be genuinely uncomfortable or embarrassing for me to land on
- I keep facing the same shape of decision over and over and starting from scratch every time, and I know I’ve lived through situations just like it that turned out a certain way
Practices that may help
- Trim model complexity
Prefer the simplest model of a situation that still fits all the evidence.
Occam’s Razor: Prefer the Simpler Explanation - Test each component probability separately
Before judging a joint claim, estimate each element on its own, then check whether the conjunction is lower.
The Conjunction Fallacy — When "More Details" Feels More Likely - Identify which features are actually diagnostic
Separate features that genuinely differentiate categories from ones that just complete the picture.
The Representativeness Heuristic — Judging by Resemblance - Set the constraint: what conclusions would you not accept?
Pre-define which conclusions would be embarrassing, then monitor whether your reasoning is steering away from them.
Motivated Reasoning - Build a library of cases and reason from them
Accumulate a diverse set of cases with known outcomes, and retrieve structurally similar ones when facing a new problem.
Analogical Reasoning - Motivated Reasoning
Motivated reasoning, studied extensively by Ziva Kunda and others, is the tendency to reason toward a conclusion you want to reach rather than wherever the evidence leads. It is not conscious deception — the brain generates genuinely felt arguments for the preferred conclusion. Detection and structured debiasing techniques reduce but do not eliminate it; awareness alone is insufficient. - Look up base rates before forming a resemblance judgment
Before deciding "this looks like X," ask how common X actually is in the relevant population.
The Representativeness Heuristic — Judging by Resemblance - For many decisions, going with your gut outperforms lengthy analysis
Over-explaining reasons for a preference can actually detgrade the quality of affective predictions.
Affect Forecasting: Why You Mispredicted How You’d Feel - Update beliefs by degrees, not wholesale
Treat new information as evidence that shifts probabilities, not as proof that changes everything.
Base-Rate Neglect: Why We Ignore the Odds - Question whether the category you’re reasoning from actually fits
Before applying a model or framework, verify that the category it was built on genuinely matches your situation.
The Ludic Fallacy: When You Mistake Real Life for a Game
Related concerns
- Consistent Reasoning Standards
Before reasoning about something, ask whether you are trying to reach a specific answer or the correct one.
Distinguish directional from accuracy goals before you start
- Assumption Counting
Name the assumptions filling the gap between the data you selected and the interpretation you reached.
Surface and examine the assumptions you are making
- Authority Bias Reasoning
Deliberately generate the case for the conclusion you are not reaching.
Consider the opposite before finalizing a judgment
- Backward Reasoning
Notice when the conclusion appeared before the evidence — and treat that as a red flag.
Catch yourself working backward from a conclusion
- Diagnostic Reasoning
Notice when the conclusion appeared before the evidence — and treat that as a red flag.
- Likelihood Ratio Evidence
Ask how much more likely this evidence would be if you’re right versus if you’re wrong.
Evaluate evidence by its likelihood ratio, not by how it makes you feel
Describe your situation in your own words to search the complete practice library.