Main Tropes Index

Troperville

Editing

Tools

Toys

Narrative

Genre

Media

Topical Tropes

Other Categories

Custom Search

Lies, Damned Lies, and Statistics
alt title(s): Lies Damned Lies And Statistics
"90% of all statistics can be made to say anything...50% of the time."
Out-of-touch Marketing Guy, Direct TV Commercial

"Ever since the formation of the Justice League, half of all marriages have ended in divorce! And the other half in DEATH!!"
Glorious Godfrey lookalike, Justice League

This well-known saying is part of a phrase attributed to Benjamin Disraeli and popularized in the U.S. by Mark Twain: "There are three kinds of lies: lies, damned lies, and statistics." As someone might put it, statistics can be falsified to prove anything. 80% of the world's population knows this - and 54% of the world's comedians have made that joke.

Lies are not allowed in 99% of spheres. Damned lies are about 64% worse, and definitely not allowed. Statistics, however...

With the magic of numbers you can lie without getting into trouble!

This trope covers all instances where statistics are used to deceive people as to the truth. The fact is that roughly 78% of people do not pay attention to the context, just the numbers. For example the statement "85% fat free" sounds really good, until you realize that this means the food product is presumably 15% fat by weight. Also "fastest growing" could just mean that they have a tiny customer base and just got a few hundred new customers, a 500% plus increase.

Around 32% of the uses of statistics are intended to imply a causal link, when either the two elements are not linked, the link is questionable, or the link is actually opposite to what is implied. A beautiful example is "Coca-Cola causes drownings." Looking at statistical data about Coca-Cola sales on a daily basis, and looking at data about drownings and near-drownings on a daily basis, you can see a link - because more people go swimming on hot days and more people buy Coke on hot days, of course! Likewise birth rates (per head of population) are higher in areas where there are more storks. Because birth rates are always higher in rural areas, which is where one finds the Delivery Stork, duh!

One might compare the way people use statistics it to the way a drunk uses a lamp post - for support, not illumination.


Examples:

  • During World War One helmets were almost withdrawn from British soldiers when it was noticed that the rate of head wounds had shot up after their issue. The reason? A person who dies from a bullet in the brain is a "casualty." A man with severe concussion or a skull fracture is a "head wound." The rate of head wounds shot up and one of the "Helmets are expensive and cause cowardice" politicians decided to leap on it. He never used the total figure, only the one figure that helped his case.
  • Something of a historical subversion: During WWII, the air force wanted to add more armour to their planes, but because of weight limits they needed to know which places needed the armour most. So, they examined the planes after they came back and counted how often bullet holes were found in certain areas... and then placed armour in places that showed the fewest bullet holes. This is because, they assumed, that any place that did have bullet holes was a place that planes could be hit and still fly.
  • Let's say you want to "prove" that video games cause violence. First, you need to get a group of scientists that are already savvy to this and don't mind the lack of ethics. Then, you have them draw from a very small pool of test subjects that are known to display violent behavior. Mental hospitals, prisons, schools for children with behavior disorders, what have you. Do some generic tests that are guaranteed to show up positive, come up with numbers, and presto, instant headline. "Recent test shows 77% of subjects become more violent after playing Mortal Kombat". This works because the plebs you're trying to convince will not read the article the whole way through. Most will just look at the headline and that's all you really need to quote at speeches and debates. This also works with Comic Books, and with Rock, Hip hop, porn, watching Brokeback Mountain, voting Democratic, voting Republican... actually, every known behavior can be presented to encourage violence and other unpleasant things. Must be a strange subversion of Rule Thirty Four.
    • And if you want even more confusion, consider the FBI study. It proves that video games REDUCE teen crime rates. Specifically, there was a drastic decrease in teen crime rates coinciding with the release of the original Grand Theft Auto. Naturally, the media seems to figure that this means that they're committing 200 million times as many crimes (my hyperbole, not theirs), but that they aren't being reported.
    • There's an oft-cited study that shows playing violent video games causes abnormal activity in the amygdala (emotional response center), which the media naturally links to violent crime. One professor at a different university was curious and did his own study; he found that Rocky caused the same effect in the same percentage of test subjects. And of course no one in the media has anything against movies.
  • An Australian national newspaper once received a letter from a man who was shocked to discover that 50% of Australian children scored lower on test scores than the average. Think about that...
    • But be careful. Question: How many people have more legs than the average? Answer: Almost everyone. This is because the number of three-legged people are greatly outnumbered by one-legged people, so the mean (i.e. the posh mathematical way of saying that which most people think of as the 'average' [total sum divided by number of values]) number of legs is a little bit lower than 2.
    • Similarly, the original shocking fact is only a "no duh" situation if "average" means "median". Ideally, most children would score relatively high on the scale, so it would be possible to be much more of an outlier on the low end than on the high end, so at least a little more than half the children should have grades above the mean.
      • This assumes that the test isn't designed to produce a bell curve, of course.
  • Consider the following. "Most car accidents occur close to home." The implication from that sentence alone is that somehow being close to home "causes" accidents; perhaps people are less careful. However, add this fact; Most driving occurs close to home.
    • It's a bit like the "statistics" on shark shows. "You are more likely to die on the toilet than be eaten by a shark." When you compare how much time you spend around sharks versus how much time you spend around toilets ... I mean, really, the toilet has time to plan out its move in advance.
    • Same deal with most accidents occurring in the home. Considering that you spend the majority of your time in your home, this should come as no surprise to anyone.
  • One of Bothered About Dungeons and Dragons (BADD)'s favourite weapons was a list of over 500 Americans they claimed were gamers who had committed suicide is the same year. Thus role playing games cause suicide. Except that 500 suicides a year is a lower percentage of suicides than clergy and a tiny fraction of the average.
    • Patricia Pulling, the leader of this organisation, once said in an interview that "8% of the Richmond VA-area population is involved with Satanic worship at some level." When asked where that figure came from, she said that she estimated 4% of the teenagers and 4% of the adults. She then added them together and got the 8% (making this a You Fail Statistics Forever as well).
    • Another time, BADD cited an increase in suicides corresponding with a major Dungeons and Dragons release. However there's no evidence that's not simply a coincidence, as similar statistics can be used to prove that the release of a Brittney Spears CD caused suicide numbers to jump.
  • Newspapers love doing this with drug related stories. It's almost impossible to see Ecstasy mentioned in a British newspaper without the qualifier "That killer drug", the supporting statistic is of course that a dozen people die per year from consuming it. Yet over the course of a year they will rack up an impressive body count in stories about fatal car accidents without ever devolving into calling cars "Those murderous rampaging kill bots" How many Britons drive? How many take E?
    • A related strategy was used by US president Richard Nixon to portray marijuana as a gateway drug. His anti-drug team estimated that 80% of marijuana users go on to use cocaine, a figure which they obtained by taking the number of cocaine users and dividing it by the number of those users who had started by using marijuana. This ignored the fact that out of all marijuana users, only about one in 2,400 go on to use cocaine.
  • "Nine out of ten dentists recommend Trident for their patients who chew gum." The tenth dentist was insistent that his patients never chew gum at all, but surprisingly, Trident didn't want you to know about that.
    • Nine Out Of Ten Doctors Agree has been practically a stock phrase in advertising since the early 20th century.
    • This kind of pitch was beautifully skewered by Stan Freberg in the early 1960s in an ad for Chun King Chinese food: the nine recommending doctors were all smiling Asians; the tenth, a scowling Anglo.
    • "More doctors smoke Camels than any other cigarette."
    • The great question never answered is: Why do the tenth Doctor/Dentist/Lawyer/Fireman/Whoever doesn't use/approves the product.
      • A Mad Magazine cartoon answered this: "Four out of five dentists recommend you floss daily!" The fifth dentist is a surly-looking individual who mutters "I'm sure you have better things to do with your time.."
      • Pearls Before Swine occasionally has the Five Doctors follow Rat around to comment on his activities. The fifth doctor is ALWAYS The Runt At The End.
  • Yes Minister has a very interesting section on this. In a discussion about conscription, Sir Humphrey demonstrates to Bernard how statistics can be obtained which prove both sides of the discussion correct, through the use of leading questions which are not included in the reporting of the survey concerned.
  • Penn & Teller's Bullshit point it by having a man who makes pool research for the Republicans show he can make someone give two different answers to the same question by first asking: "Do you think the government expends too much in healthcare for immigrants?" The bystander answers "Yes". When he asks: "Would you deny an immigrant the right to treat himself? To give birth in a hospital? Etc..." and other medical services that go well beyond what the governments expends with immigrant healthcare, the answer now is: "No". Also, they make fun of the guy with his own mathematical wizardry by pointing out: "In this scene, ten cars pass by behind him. One guy from one of the cars shouts saying he sucks. This means that AT LEAST 10% of the American population believes he sucks".
  • Darrell Huff's "How To Lie With Statistics" was printed in the 50's. It's usually available on eBay and is a very easy read that shows you all the basics.
  • Statistically, there are 2 Popes per square kilometer in the Vatican, which is 1/2 of a square kilometer. Tee-hee, funny joke ... but remember that, the next time someone tells you how many Republicans or Democrats there are in a particular region. Did they count them? No.
    • On average, an adult human has one testicle.
      • And less than two legs.
      • Strictly, it's probably less than one - there are very slightly fewer women than men in the world, but a small but significant proportion of men have less than 2 testicles.
  • Bayesian Probability throws up a lot of these as it depends on the statement 'the probability of x given y' and how this should affect your perceptions. My favourite is where confessing to a crime is more likely to make you innocent - the idea being that for certain big-ticket crimes like organised crime or terrorism the perpetrators are more likely to be trained in resisting interrogation and will never confess, whereas a 'normal' person will confess, telling the interrogator what they want to hear.
  • A recent Ars Technica article discussed the statistics usually used by software developers to complain about piracy. Specifically, the article pointed out that the statistics most commonly cited are most likely not only bullshit, but old bullshit. Amusingly enough, the image used for the related post on Gamepolitics was a pie chart divided into three sections, marked "Lies/Damned Lies/Statistics".
  • A recent Trojan Condoms commercial claims that the United States ranks between two African nations in HIV cases. This means nothing, since the population of the USA is much higher than either of those countries!
  • Anti-pornography activists sometimes cite studies showing a correlation between areas with higher rates of pornography consumption and higher rates of rape. While this is true, there's an even bigger correlation between rape and the consumption of non-pornographic "manly" magazines like Field and Stream and Guns & Ammo, yet no one suggests that preventing men from reading magazines about hunting and guns would lead to less rape. If you want to go with Guns and Ammo I'm sure certain studies would say that the more freely weapons and ammo are available the higher the murder rate.
  • Even QI falls victim to this from time to time. One question was "What is three times more dangerous than war?" The answer given was work, because three times as many people are killed each year in work-related accidents than die in wars. Now, consider how much time you spent working last year compared to how long you were in a warzone.
    • Of course, QI is well known for deliberately phrasing questions like this in order to confuse the participants. See also "how many moons does the Earth have" - Crowning Moment Of Funny as it was, Cruithne and similar objects are near-Earth asteroids in resonant orbits rather than moons in the usual sense.
  • Played for laughs in one Dilbert strip: The Pointy Haired Boss is upset because 40% of all sick days are taken on Mondays and Fridays. With a little bit of thought, he would have realized that that's exactly what it should be, since 20% is one out of five, and 40% is two out of five.
  • Employees at a certain chain book store were told they needed to get people to sign up for the loyalty card on the grounds that people with the card spend on average $2 more per transaction and thus getting them the card would cause them to spend more. Never mind that most of the loyalty perks were based on how much you spent and thus people who spent more tended to use the card more.
  • There is a semi-famous magazine article from 1958 called "The Dread Tomato Addiction" that correlates consumption of tomatoes with everything from death to communism. It can be found here.
  • There have been so many books that claim that they are the number 2 selling book, under the Bible. Isn't there ever a book that sells more than the Bible? How can there be so many number 2's? Or is this at different time periods?
    • No book ever sells more than the Bible because "the Bible" is a very vague term if you're talking about book sales. Which translation? Published when? By whom?
  • The Column 8 column in the Sydney Morning Herald once referenced a statistical correlation between the difficulty of the sudoku on a given day and the price of petrol.
  • When Ronald Reagan's Attorney General Edwin Meese wanted "proof" that pornography was evil, he created the Attorney General's Commission on Pornography. The commission members were a pre-selected cohort of anti-pornography campaigners. Not surprisingly, they discovered that statistics "proved" that pornography caused crime. However, the 1970 report of the President's Commission on Obscenity and Pornography, which was done by honest researchers and was highly praised for accuracy and honesty, discovered that there was "no evidence to date that exposure to explicit sexual materials plays a significant role in the causation of delinquent or criminal behavior among youths or adults."
  • There is a book produced for people in radio every year that compiles countless statistics about all stations taken from polls. These are used to attract advertisers. The less successful stations who have very few listeners are often forced to hire people who read through the book to get as many favorable statistics as possible, no matter how convoluted they may be. With the huge amount of data in the book, it's possible to say, for instance, that 85% of married men aged some arbitrary amount with income in some arbitrary range and who own a ferret will love your show, even though they represent a tiny proportion of the population. It does get them advertisers, so it works out in the end.
  • The Justice League quote at the top is an often alluded to occurrence of this. Aside from the fact that the same was true before the formation of the League, until the end of time, a significant portion of marriages will end in death, as people do have a tendency to die, married or not.