Pre-explanation rating with commitment
Rate your understanding before attempting to explain — not after — and record the number.
Why it works
The IOED collapse is most informative when the pre-explanation rating is recorded before any explanation attempt. Committing to a number in advance prevents post-hoc revision of the pre-explanation rating, making the gap between felt understanding and demonstrated understanding visible rather than retrospectively redefined. Over repeated instances, the persistent gap motivates investment in genuine mechanistic learning.
How to do it
- Before attempting to explain a concept, write your understanding rating (0–10) and what that means specifically.
- Attempt the mechanistic explanation.
- Re-rate on the same scale after the explanation.
- Record both numbers and the gap; do not revise the pre-explanation rating retroactively.
Evidence
Pre-commitment to a judgment prevents the post-hoc adjustment that reduces the perceived gap between prediction and outcome. This methodological principle is the same one that makes Rozenblit and Keil’s procedure diagnostically powerful. Rozenblit and Keil (2002) recorded understanding ratings before explanation precisely so the collapse could not be retroactively explained away, and Fernbach et al. (2013) used the same before-and-after rating structure to show the drop generalizes to policy attitudes. (mechanistic)
The commitment-and-gap procedure is a practitioner adaptation of Rozenblit and Keil’s research paradigm; as a personal practice tool it is not independently tested.
Sources
- Rozenblit, L., & Keil, F. (2002). The misunderstood limits of folk science: An illusion of explanatory depth. Cognitive Science, 26(5), 521-562.
- Fernbach, P. M., Rogers, T., Fox, C. R., & Sloman, S. A. (2013). Political extremism is supported by an illusion of understanding. Psychological Science, 24(6), 939-946.
Common mistake
Rating understanding after attempting explanation, which allows the failure of explanation to reduce the rating retroactively — destroying the diagnostic gap that motivates further learning.
Practice this with IX Coach
7 days free, then $40/month (~$1.30/day).
More practices for Illusion of Explanatory Depth: You Know Less Than You Think
- Explain the mechanism, not the function
When you think you understand something, try to explain how it works step-by-step — not just what it does.
- Third-party explanation test
Explain the concept to a person who knows nothing about it and let their questions expose your gaps.
- Knowledge-boundary identification
Map the exact point where your understanding runs out rather than treating it as a vague area of weakness.
- System mapping before explanation
Draw the causal chain before writing or speaking — gaps in the diagram are gaps in understanding.
- Expert-explanation comparison
After explaining a concept yourself, compare your explanation to an expert’s and locate the differences.
- Adjacent-domain transfer testing
Test understanding by applying the mechanism to a new domain — genuine understanding transfers; IOED does not.
Related concepts
- The Fluency Illusion: Why Easy Reading Fools You Into Thinking You’ve Learned
The cognitive bias that wastes study time and how to break its grip
- Feeling of Knowing: Why Your Confidence Misleads You
Understanding and correcting the metacognitive illusion that undermines effective study
- Judgments of Learning: Why You Misjudge What You’ve Learned
The science of metacognitive prediction accuracy and how to improve it
- The Feynman Technique, Step by Step
Explain it simply, find the gaps, and close them