Probability & Statistics
4 ExercisesThe maths of uncertainty, applied to the decisions you actually make.
Overview
Probability and statistics are where human intuition fails most predictably, from misreading medical test results to seeing patterns in noise. This category trains base-rate thinking, Bayesian updating, and the identification of statistical fallacies in the contexts where they actually cause harm.
Probability and statistics are the formal language of uncertainty. These exercises translate that language into everyday reasoning. You already think probabilistically without noticing. A friend tests positive for a rare disease. A candidate is leading in the polls. A stock is down 30% from its peak. You are doing probability, often badly. The exercises drill the moves that separate accurate judgment from gut feeling: base rates, conditional probability, sample size, regression to the mean, and Bayesian updating.
The single most important idea is the base rate, meaning how common something is before you see any specific evidence. People reliably ignore it in favour of vivid case detail, which produces confident errors in the wrong direction. Beginner exercises cover simple calculations and common formats. Intermediate ones add conditional probability and the rare-disease test puzzle. Advanced ones cover Bayesian reasoning and statistical illusions. If maths intimidates you, relax. The emphasis is on concepts, not arithmetic.
Stakes
Probability literacy measurably improves health, money, and policy decisions. Doctors and patients who reason in natural frequencies ('10 out of 1,000') make systematically better choices than those reasoning in percentages, because the frequency framing makes the base rate impossible to ignore. Practice these and you reach that framing automatically.
It pays off professionally too. Analysts, product managers, clinicians, and journalists all make probability judgments constantly. Over a career, the gap between someone calibrated about uncertainty and someone who is not is enormous. A few base-rate errors in high-stakes decisions can dwarf every other reasoning weakness combined.
Hazards
The reasoning errors these exercises specifically train against.
Given specific evidence about one case, people fixate on the case and ignore how common the thing actually is. A 95% accurate test for a 1-in-10,000 disease produces mostly false positives. Most people still guess that a positive result means the patient probably has it.
The chance of cancer given a positive test isn't the same as the chance of a positive test given cancer. Swapping those two is the technical heart of base-rate neglect, and the exercises drill the difference until it's automatic.
A 70% success rate from 10 tries is far weaker evidence than a 60% rate from 1,000. People treat percentages as comparable regardless of the sample behind them, which produces huge misjudgments of how strong the evidence is.
Extreme results tend to be followed by less extreme ones, with no causal change at all. Crediting that natural drift to an intervention is the source of many false beliefs about coaching, medicine, and personal habits.
Method
Each exercise presents a probabilistic scene and asks for the right reading. A medical test. A poll. An A/B result. An investment claim. The wrong answers reflect the canonical errors: base-rate neglect, sample-size blindness, misread conditionals. The explanations rephrase the problem in natural frequencies, which makes the right answer obvious, then show how the original framing produced the mistake.
Most exercises can be reasoned qualitatively, with rough estimates instead of precise maths. The goal is calibrated intuition rather than numerical fluency. You glance at a claim and sense immediately whether it is plausible. Fluency comes later. The conceptual moves come first.
4 Exercises
Start anywhere, finish at your own pace.
Confront the scenarios where human intuition about probability fails most dramatically, from emergency rooms to courtrooms to casinos. These puzzles expose systematic flaws in how our brains estimate likelihood, teaching you to recognize when your gut feeling is being hijacked by cognitive shortcuts. Mastering these foundations will change how you evaluate risk in medical decisions, financial choices, and everyday life.
Develop the skills to interrogate statistical claims you encounter in news headlines, pharmaceutical ads, corporate earnings reports, and political campaigns. These exercises train you to spot the specific techniques that make misleading numbers look convincing, from axis manipulation to cherry-picked comparisons to survivorship bias. You will learn to ask the right questions before accepting any statistical claim at face value.
Master the framework that doctors, intelligence analysts, and data scientists use to update beliefs rationally when new evidence arrives. These exercises build your intuition for Bayes' theorem through scenarios involving criminal investigations, medical diagnosis, A/B testing, and geopolitical analysis. You will learn when evidence should dramatically change your mind versus when it should barely shift your confidence.
Identify the most dangerous statistical fallacies that lead to wrongful convictions, failed policies, wasted research funding, and medical harm. These advanced scenarios test whether you can spot subtle errors involving Simpson's paradox, the prosecutor's fallacy, multiple comparisons, selection bias, and expected value traps that regularly fool judges, journalists, scientists, and executives.
In the wild
Deeper look
Probability is where human intuition fails most consistently and most expensively. Doctors misread test results in ways that change treatment. Juries misjudge match-probability evidence in ways that change verdicts. Investors overweight rare events and underweight cumulative ones, and wreck portfolios doing it. None of this is stupidity. It is the predictable output of a mind built for small-sample reasoning that now handles large-scale data and complex risk.
One robust finding shapes the whole category. The same problem that most physicians get wrong in percentages, most of them get right in natural frequencies. The fix is mechanical. Translate into frequencies, draw the tree, and apply Bayes' rule explicitly. The same handful of moves span wildly different domains. The base-rate translation that fixes the mammogram problem also fixes misread DNA evidence in court. The cumulative-probability calculation that stops a mayor dismissing a 2% annual flood risk also stops a homeowner dismissing the odds an appliance fails over its lifetime.
Theory
Exercises build the reflex. These lessons explain why it works.
Take critical thinking beyond theory. Learn to generate ideas, judge the media you consume, and solve tangled real-world problems.
Separate generating ideas from judging them, so the wild ones survive
Tell news, opinion, and advertising apart, even when they blur
FAQ
Sources
Primary sources and reputable references for the concepts covered above.
Keep going
Rotating across categories beats grinding one type. The contrasts are what make each pattern stick.
