Coaching practices for How to Design an Unbiased Search
Describe almost anything you are working through and IX Coach finds the practices whose real-world fit is closest. For How to Design an Unbiased Search, these are the strongest matches in the current practice library.
Does this sound like the set of challenges you might be facing?
- I start "researching" a question but I notice I’m really just typing in searches that hand me the answer I already wanted
- I start browsing before I’ve worked out what I actually want, and the flashy features of whatever I see first quietly rewrite what I think I’m looking for
- I’m sure about my read on this, but I only ever notice the things that confirm what I already think
- I’ve decided the lesson from this success is “focus narrow” or “go big”
- I’m about to lock in a judgment and I’m only seeing the evidence that backs it
Practices that may help
- Structure the analysis before searching for evidence
Define what you’re looking for and what would count as evidence before starting your search.
Confirmation Bias: Seeing What You Expect to See - Elicit your real standards before you look
Write down what a good outcome actually requires before options are visible.
Choice Overload, Made Practical - Notice which data you selected — and which you ignored
Your conclusions are built on a sample of the available data — ask what the sample excluded.
The Ladder of Inference - Steelman the strategy opposite to the successful one
Before adopting a lesson from a success story, build the best possible case for the opposite approach.
Survivorship Bias: Learning from What You Can’t See - Consider the opposite before finalizing a judgment
Deliberately generate the case for the conclusion you are not reaching.
Motivated Reasoning - Set a “good enough” bar before you search
Decide your criteria first, then take the first option that clears them.
Satisficing vs. Maximizing: When “Good Enough” Wins - Use "take the best": choose on your single most informative cue
When choosing between options, identify the most diagnostic cue and use it — stop searching for more.
Simple Heuristics: Gerd Gigerenzer’s Case for Fast and Frugal Thinking - Adopt satisficing instead of maximizing
Set a "good enough" threshold before you search, then stop when you hit it.
Choice Overload, Made Practical - Evaluate each option against your criteria before comparing options to each other
Score options independently first — so the comparison set can’t retroactively redefine what good looks like.
The Decoy Effect — How an Irrelevant Option Changes Your Choice - Sequence information so the most favorable item follows the least favorable
Present a weaker option or negative context first so that your preferred option shines by comparison.
The Contrast Principle, Made Practical
Related concerns
- Pre Specified Criteria Decisions
Set a "good enough" threshold before you search, then stop when you hit it.
Adopt satisficing instead of maximizing
- Set Criteria Before Deciding
When choosing between options, identify the most diagnostic cue and use it — stop searching for more.
Use "take the best": choose on your single most informative cue
- Data Selection Bias
Your conclusions are built on a sample of the available data — ask what the sample excluded.
Notice which data you selected — and which you ignored
- Decision Criteria
When choosing between options, identify the most diagnostic cue and use it — stop searching for more.
- Decision Standards
Set a "good enough" threshold before you search, then stop when you hit it.
- Filter Before Comparing
Awareness of the contrast principle is the antidote — evaluate options against an independent standard, not the presented sequence.
Recognize when contrast is being used on you
Describe your situation in your own words to search the complete practice library.