Critical Thinkingexercises

Probability & Statistics Exercises

The math of uncertainty, applied to the decisions you actually make.

In short

Probability and statistics are where human intuition fails most predictably, from misreading medical test results to seeing patterns in noise. This category trains base-rate thinking, Bayesian updating, and the identification of statistical fallacies in the contexts where they actually cause harm.

Try one nowBeginner

In the Monty Hall problem: You're on a game show and pick Door 1. The host, who knows what's behind every door, opens Door 3 to reveal a goat. He offers you the chance to switch to Door 2. A friend says, 'It's 50/50 now, two doors and one car, so it doesn't matter.' What should you do?

Play a game

Practice the same skill in an interactive game. Free, no signup.

What probability & statistics training covers

Probability and statistics are the formal language of uncertainty. These exercises translate that language into everyday reasoning. You already think probabilistically without noticing. A friend tests positive for a rare disease. A candidate is leading in the polls. A stock is down 30% from its peak. You're doing probability, often badly. The exercises drill the moves that separate accurate judgment from gut feeling: base rates, conditional probability, sample size, regression to the mean, and Bayesian updating.

The single most important idea is the base rate, meaning how common something is before you see any specific evidence. People reliably ignore it in favor of vivid case detail, which produces confident errors in the wrong direction. Beginner exercises cover simple calculations and common formats. Intermediate ones add conditional probability and the rare-disease test puzzle. Advanced ones cover Bayesian reasoning and statistical illusions. If math intimidates you, relax. The emphasis is on concepts, not arithmetic.

Why this skill matters

Probability literacy tends to improve health, money, and policy decisions. Doctors and patients who reason in natural frequencies ('10 out of 1,000') tend to make better choices than those reasoning in percentages, because the frequency framing makes the base rate impossible to ignore. Practice these and you reach that framing automatically.

It pays off professionally too. Analysts, product managers, clinicians, and journalists all make probability judgments constantly. Over a career, the gap between someone calibrated about uncertainty and someone who isn't is enormous. A few base-rate errors in high-stakes decisions can outweigh most other reasoning weaknesses.

Common pitfalls

The reasoning errors these exercises train you to catch.

Base-rate neglect

Given specific evidence about one case, people fixate on the case and ignore how common the thing actually is. A 95% accurate test for a 1-in-10,000 disease produces mostly false positives. Most people still guess that a positive result means the patient probably has it.

Confusing P(A|B) with P(B|A)

The chance of cancer given a positive test isn't the same as the chance of a positive test given cancer. Swapping those two is the technical heart of base-rate neglect, and the exercises drill the difference until it's automatic.

Ignoring sample size

A 70% success rate from 10 tries is far weaker evidence than a 60% rate from 1,000. People treat percentages as comparable regardless of the sample behind them, which produces huge misjudgments of how strong the evidence is.

Missing regression to the mean

Extreme results tend to be followed by less extreme ones, with no causal change at all. Crediting that natural drift to an intervention is the source of many false beliefs about coaching, medicine, and personal habits.

How the exercises are structured

Each exercise presents a probabilistic scene and asks for the right reading. A medical test. A poll. An A/B result. An investment claim. The wrong answers reflect the canonical errors: base-rate neglect, sample-size blindness, misread conditionals. The explanations rephrase the problem in natural frequencies, which makes the right answer obvious, then show how the original framing produced the mistake.

Most exercises can be reasoned qualitatively, with rough estimates instead of precise math. The goal is calibrated intuition rather than numerical fluency. You glance at a claim and sense immediately whether it's plausible. Fluency comes later. The conceptual moves come first.

Where this skill applies

  • Medical decisions. Weighing a screening recommendation, a treatment, or whether to get a second opinion all go better with base-rate-first reasoning than with intuition.
  • Reading polls and forecasts. Elections, weather, and economic predictions are probabilistic claims most people misread. With practice, you can pull calibrated information out of otherwise misleading coverage.
  • Experimenting at work. Anyone running A/B tests or pilots benefits from understanding sample size, variance, and the gap between an underpowered and an informative experiment.

Where this skill fits

Probability is where human intuition fails most consistently and most expensively. Doctors misread test results in ways that change treatment. Juries misjudge match-probability evidence in ways that change verdicts. Investors overweight rare events and underweight cumulative ones, and wreck portfolios doing it. None of this is stupidity. It's the predictable output of a mind built for small-sample reasoning that now handles large-scale data and complex risk.

One well-replicated finding shapes the whole category. The same problem that most physicians get wrong in percentages, most of them get right in natural frequencies. The fix is mechanical. Translate into frequencies, draw the tree, and apply Bayes' rule explicitly. The same handful of moves span wildly different domains. The base-rate translation that fixes the mammogram problem also fixes misread DNA evidence in court. The cumulative-probability calculation that stops a mayor dismissing a 2% annual flood risk also stops a homeowner dismissing the odds an appliance fails over its lifetime.

Learn the theory behind this

Exercises build the reflex. These lessons explain why it works.

Further reading

Primary sources and reputable references for the concepts covered above.

Frequently asked questions

Do I need to remember formulas?

No. The exercises are conceptual, not computational. Almost everything can be reasoned about in natural-frequency terms (10 out of 1,000), which avoids the formula-heavy version of probability. If you ever take an actual statistics course, the conceptual fluency these exercises build will make the formulas much easier to remember.

What is Bayesian reasoning, in plain English?

Updating your belief in a claim by combining your prior probability (what you thought before) with the strength of the new evidence (how much more likely the evidence is if the claim is true versus if it's false). The exercises walk through this process in everyday scenarios so the formal math becomes optional.

How is this category different from scientific reasoning?

Scientific reasoning is about the design and interpretation of empirical claims. What is the hypothesis? What controls were used? What alternative explanations exist? Probability and statistics is the math of uncertainty itself. They are complementary. Scientific reasoning produces the question and statistics frames the answer.

Are these exercises useful for jobs that involve data?

Yes. They target the conceptual mistakes that data-handling roles make most often. Even people with formal statistics training fall into base-rate and sample-size errors in unfamiliar contexts. The exercises drill these patterns until catching them is automatic.

Explore another category

Rotating across categories beats grinding one type. The contrasts are what make each pattern stick.