Cognitive Biases

Survivorship Bias

Survivorship bias is drawing conclusions from the cases that made it through some selection process while ignoring those that did not. Because failures are usually invisible, the surviving sample looks representative when it is not, and the traits shared by survivors get mistaken for the causes of survival.

By Tajammal MaqboolFounder & Developer

Drawing conclusions only from cases that made it past a selection filter while overlooking the failures that did not, distorting the picture.

Example: Studying only the founders who got rich, you copy their habits — and never see the many who did the same and failed.

What it looks like

In a business book

All five of these founders dropped out of college, so dropping out frees you to build something great.

Why it fails: The sample is drawn from successful founders. The far larger group who dropped out and failed is absent, so nothing can be inferred about dropping out as a strategy.

In a discussion about old buildings

Buildings used to be made so much better — look how many centuries-old ones are still standing.

Why it fails: Poorly built structures from the same era collapsed or were demolished long ago. What survives is the best of its period, compared against everything built today.

In an investment pitch

This fund strategy has beaten the market for eight straight years.

Why it fails: Funds that performed badly are closed or merged away, so the surviving list is filtered for success. Across enough funds, some streak that long occurs by chance alone.

Practice

5 questions. Answer each one, then read why the tempting wrong answers are wrong.

Question 1

In WWII, Abraham Wald was asked where to add armour to bombers, based on damage patterns in returning aircraft. Damage clustered on wings and fuselage. What did he conclude?

Question 2

Which question best exposes survivorship bias in a claim about what successful people do?

Question 3

Why is survivorship bias particularly hard to notice?

Question 4

A study finds that patients who completed a twelve-month treatment programme had excellent outcomes. What is the survivorship concern?

Question 5

How does survivorship bias relate to hasty generalization?

Frequently asked

How do I check for survivorship bias?
Ask what process determined which cases you can see, and whether that process is related to the outcome being studied. If entry into the dataset depends on succeeding, surviving, or completing, the sample is selected on the outcome and cannot support conclusions about causes.
Is survivorship bias the same as selection bias?
It is a specific type of selection bias — the one where selection happens by surviving or succeeding. Selection bias is the broader family covering any systematic difference between who is in the sample and who is in the population, including self-selection and non-response.
Why is survivorship bias common in advice about success?
Because successful people are the ones who get interviewed, write books, and give talks. The failures who followed identical strategies are neither sought out nor inclined to publish, so almost all available advice is drawn from a sample selected on the outcome it claims to explain.