Coaching practices for Law of Small Numbers
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For Law of Small Numbers, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- A handful of early results point one clear direction and I’m already drawing a firm conclusion
- I read about someone who made it big doing this one thing and immediately think I should do the same
- After a long run of the same result I feel certain the other way is overdue
- I keep hearing about the handful of people this worked out for and it’s pulling me in
- I’m about to launch into something and I keep estimating how it’ll go off the handful of vivid winners in my head
Practices that may help
- Treat small samples with explicit skepticism
A short sequence can look representative without being statistically reliable — adjust confidence for sample size.
The Representativeness Heuristic — Judging by Resemblance - Ask for the failure rate before celebrating the success rate
Before drawing lessons from any success story, ask: out of how many attempts did this succeed?
Survivorship Bias: Learning from What You Can’t See - Recognize that random sequences don’t "owe" balance
Random processes have no memory — a run of heads doesn’t make tails more likely.
The Representativeness Heuristic — Judging by Resemblance - Always identify the denominator when evaluating risk or success
When a number or story is striking, ask: "Out of how many total cases?"
Base-Rate Neglect: Why We Ignore the Odds - Choose the right reference class for any prediction
Find the statistical base rate for the category your decision belongs to — not just the inspiring examples.
Survivorship Bias: Learning from What You Can’t See - Trim model complexity
Prefer the simplest model of a situation that still fits all the evidence.
Occam’s Razor: Prefer the Simpler Explanation - Deliberately invoke the outside view for important decisions
For any high-stakes prediction, force yourself to start with how things typically go, not how your situation feels.
Base-Rate Neglect: Why We Ignore the Odds - Expect extreme results to regress toward average
Unusually good or bad performance predicts more average performance next time — account for this before giving praise or blame.
The Representativeness Heuristic — Judging by Resemblance - Weigh disconfirming evidence more heavily than confirming evidence
One strong counterexample outweighs many confirming examples for a universal claim.
Falsification Thinking - Beware false precision in forecasts and models
Treat any precise probability or quantitative forecast with explicit suspicion about whether the model fits the domain.
The Ludic Fallacy: When You Mistake Real Life for a Game
Related concerns
- Hot Hand Fallacy
Random processes have no memory — a run of heads doesn’t make tails more likely.
Recognize that random sequences don’t "owe" balance
- Small Sample Size Bias
A short sequence can look representative without being statistically reliable — adjust confidence for sample size.
Treat small samples with explicit skepticism
- When Representativeness Heuristic Small Sample Skepticism
A short sequence can look representative without being statistically reliable — adjust confidence for sample size.
- Avoid Representativeness
The representativeness heuristic is the mental shortcut of judging probability by how closely something resembles a prototype or stereotype. It is fast and often useful, but it reliably misfires when it overrides base rates, produces the conjunction fallacy, or treats random-looking sequences as unlikely.
- Base Rate Neglect Why We Ignore The Odds After A Loss
Base-rate neglect is the tendency to underweight or ignore prior probabilities (how often things happen in general) when vivid, specific information is available. Identified by Kahneman and Tversky, it is one of the most robustly replicated biases in judgment research, and it leads to systematic overconfidence in predictions about specific cases. Correcting it requires actively looking up or estimating base rates before evaluating individual information.
- How Many Tried Survivorship
Look for the people who tried the same thing and didn’t make it through.
Actively seek out the failures you aren’t seeing
Describe your situation in your own words to search the complete practice library.