By Tajammal MaqboolFounder & Developer
Develop the skills to interrogate statistical claims you encounter in news headlines, pharmaceutical ads, corporate earnings reports, and political campaigns. These exercises train you to spot the specific techniques that make misleading numbers look convincing, from axis manipulation to cherry-picked comparisons to survivorship bias. You will learn to ask the right questions before accepting any statistical claim at face value.
Statistics is the craft of pulling meaning out of data while being honest about the uncertainty around it. The basics, meaning mean, median, sample size, and confidence intervals, look simple, yet the exact same numbers, calculated correctly, can support wildly different conclusions depending on how they're read. This exercise drills the interpretive skill: telling what the numbers literally say from what people commonly take them to say.
Statistical claims in headlines, pharmaceutical advertising, and earnings reports are frequently accurate and misleading at once. This exercise trains you to interrogate them, asking what the base rate is, what the comparison group was, and whether relative or absolute change is being reported.
A few interpretive errors recur. Confusing mean with median: one billionaire drags a town's average income up while the typical income barely moves. Confusing relative with absolute risk: 'doubles your risk' sounds terrifying but can mean a jump from 1-in-100,000 to 2-in-100,000. And treating statistical significance as practical importance: a real effect can be reliable and still far too small to matter.
The skill is asking the right diagnostic questions before you accept any statistic: What's the base rate? What's the comparison group? How big was the sample? Is that number absolute or relative? Could plain random variation have produced this? Watch for options that offer a plausible-sounding misreading that flunks one of these checks. For more, see Scientific Thinking.
Question 1
A tech startup's CEO announces: 'Our average employee earns $145,000 per year, well above the industry median of $72,000.' A data journalist obtains the actual payroll: the company's median salary is $61,000. The CEO and three co-founders each earn over $1.2 million, while 72 other employees earn between $48,000 and $78,000. How should you interpret this?
Question 2
A pharmaceutical company shows investors a bar graph of quarterly revenue growing from $487 million to $535 million. The Y-axis starts at $475 million. The bars appear to show roughly a five-fold increase. An analyst recalculates and finds the actual growth is about 10%. What visual technique created the distortion?
Question 3
A toothpaste brand claims '4 out of 5 dentists surveyed recommend Sparkle toothpaste.' An investigation reveals two things. The company surveyed 5 dentists repeatedly until it got a favorable result. The question was 'Would you recommend Sparkle toothpaste or no toothpaste at all?' What problems undermine this claim?
Question 4
An entrepreneurship article lists 10 habits shared by billionaires like Bezos, Musk, and Zuckerberg, claiming these habits cause success. A researcher points out that the article examined zero failed entrepreneurs. What systematic error is this?
Question 5
A school district selects the 50 lowest-scoring students for a new teaching program. After one semester, these students' scores improve by an average of 15 points. The superintendent credits the program and requests $2 million to expand it district-wide. A statistician warns the improvement might not be due to the program at all. What phenomenon is the statistician concerned about?
Question 6
A news headline reads: 'New study finds eating processed meat DOUBLES your risk of colorectal cancer!' The actual study found daily processed meat consumption increased lifetime colorectal cancer risk from 5% to 6%. Your coworker panics and throws away all the deli meat in the office fridge. What critical distinction is missing from the headline?
Where to go after this exercise.
