Every day we’re overwhelmed by an avalanche of figures and information.
Our tendency to believe in statistics is increasing, because we think they give us certainty. But numbers can and must be taken with a pinch of salt: statistics cannot make precise what isn’t precise.
When you see a statistic or figure somewhere, ask yourself the following six questions:
Do not just accept a statistic. Be critical and look for sources or studies that explain the story from a different angle.
Does a survey favour a certain party just before the elections? Or is a soft drink company telling you that sugar-free drinks are healthy? Doubt the source and look for additional studies.
Which (moral) choices were made when measuring? Is the figure about a man-made concept, such as GDP or IQ? Then pay extra attention to the interpretation. Try to find numbers that measure the concept in other ways.
Was the sample random or not? If not, the results only apply to the specific group that was examined. Of equal importance: how were the questions and answers formulated?
Always be critical, because questioning can be suggestive.
Two events occurring together do not necessarily imply a causal relationship. Always ask yourself these 3 questions:
Could it be a coincidence?
Could other factors play a role?
Could the causal relationship be reversed?
When interpreting figures, beware of:
My final advice: don’t assume all the figures you hear in an interview are true. Observe them with an open, critical mind and pick out the nonsense.
Journalist and econometrist Sanne Blauw wrote the book The best-selling book ever - how numbers lead, seduce and mislead us.
Essential reading for 2019.
You want help in analysing statistics?
Don’t hesitate to reach out.