Annotated – The Median Isn’t The Message

Preface:

In June of 1985 Dr. Stephen Jay Gould used his personal life to illustrate the importance of statistical measures, their true meaning even more so, in our lives.


The Median Isn’t The Message by Stephen Jay Gould

My life has recently intersected, in a most personal way, two of Mark Twain‘s famous quips. One I shall defer to the end of this essay. The other (sometimes attributed to Disraeli), identifies three species of mendacity, each worse than the one before – lies, damned lies, and statistics.

Consider the standard example of stretching the truth with numbers – a case quite relevant to my story. Statistics recognizes different measures of an "average," or central tendency. The mean is our usual concept of an overall average – add up the items and divide them by the number of sharers (100 candy bars collected for five kids next Halloween will yield 20 for each in a just world). The median, a different measure of central tendency, is the half-way point. If I line up five kids by height, the median child is shorter than two and taller than the other two (who might have trouble getting their mean share of the candy). A politician in power might say with pride, "The mean income of our citizens is $15,000 per year." The leader of the opposition might retort, "But half our citizens make less than $10,000 per year." Both are right, but neither cites a statistic with impassive objectivity. The first invokes a mean, the second a median. (Means are higher than medians in such cases because one millionaire may outweigh hundreds of poor people in setting a mean; but he can balance only one mendicant in calculating a median).

The larger issue that creates a common distrust or contempt for statistics is more troubling. Many people make an unfortunate and invalid separation between heart and mind, or feeling and intellect. In some contemporary traditions, abetted by attitudes stereotypically centered on Southern California, feelings are exalted as more "real" and the only proper basis for action – if it feels good, do it – while intellect gets short shrift as a hang-up of outmoded elitism. Statistics, in this absurd dichotomy, often become the symbol of the enemy. As Hilaire Belloc wrote, “Statistics are the triumph of the quantitative method, and the quantitative method is the victory of sterility and death.”

This is a personal story of statistics, properly interpreted, as profoundly nurturant and life-giving. It declares holy war on the downgrading of intellect by telling a small story about the utility of dry, academic knowledge about science. Heart and head are focal points of one body, one personality.

In July 1982, I learned. that I was suffering from abdominal mesothelioma, a rare and serious cancer usually associated with exposure to asbestos. When I revived after surgery, I asked my first question of my doctor and chemotherapist: "What is the best technical literature about mesothelioma?" She replied, with a touch of diplomacy (the only departure she has ever made from direct frankness), that the medical literature contained nothing really worth reading.

Of course, trying to keep an intellectual away from literature works about as well as recommending chastity to Homo sapiens, the sexiest primate of all. As soon as I could walk, I made a beeline for Harvard‘s Countway medical library and punched mesothelioma into the computer’s bibliographic search program. An hour later, surrounded by the latest literature on abdominal mesothelioma, I realized with a gulp why my doctor had offered that humane advice. The literature couldn’t have been more brutally clear: mesothelioma is incurable, with a median mortality of only eight months after discovery. I sat stunned for about fifteen minutes, then smiled and said to myself: so that’s why they didn’t give me anything to read. Then my mind started to work again, thank goodness.

If a little learning could ever be a dangerous thing, I had encountered a classic example. Attitude clearly matters in fighting cancer. We don’t know why (from my old-style materialistic perspective, I suspect that mental states feed back upon the immune system). But match people with the same cancer for age, class, health, socioeconomic status, and, in general, those with positive attitudes, with a strong will and purpose for living, with commitment to struggle, with an active response to aiding their own treatment and not just a passive acceptance of anything doctors say, tend to live longer. A few months later I asked Sir Peter Medawar, my personal scientific guru and a Nobelist in immunology, what the best prescription for success against cancer might be. "A sanguine personality," he replied. Fortunately (since one can’t reconstruct oneself at short notice and for a definite purpose), I am, if anything, even-tempered and confident in just this manner.

Hence the dilemma for humane doctors: since attitude matters so critically, should such a sombre conclusion be advertised, especially since few people have sufficient understanding of statistics to evaluate what the statements really mean? From years of experience with the small-scale evolution of Bahamian land snails treated quantitatively, I have developed this technical knowledge – and I am convinced that it played a major role in saving my life. Knowledge is indeed power, in Bacon‘s proverb.

The problem may be briefly stated: What does "median mortality of eight months" signify in our vernacular? I suspect that most people, without training in statistics, would read such a statement as "I will probably be dead in eight months" – the very conclusion that must be avoided, since it isn’t so, and since attitude matters so much.

I was not, of course, overjoyed, but I didn’t read the statement in this vernacular way either. My technical training enjoined a different perspective on "eight months median mortality." The point is a subtle one, but profound – for it embodies the distinctive way of thinking in my own field of evolutionary biology and natural history.

We still carry the historical baggage of a Platonic heritage that seeks sharp essences and definite boundaries. (Thus we hope to find an unambiguous "beginning of life" or "definition of death," although nature often comes to us as irreducible continua.) This Platonic heritage, with its emphasis in clear distinctions and separated immutable entities, leads us to view statistical measures of central tendency wrongly, indeed opposite to the appropriate interpretation in our actual world of variation, shadings, and continua. In short, we view means and medians as the hard "realities," and the variation that permits their calculation as a set of transient and imperfect measurements of this hidden essence. If the median is the reality and variation around the median just a device for its calculation, the "I will probably be dead in eight months" may pass as a reasonable interpretation.

Median Isn't The Message Figure 1

But all evolutionary biologists know that variation itself is nature’s only irreducible essence. Variation is the hard reality, not a set of imperfect measures for a central tendency. Means and medians are the abstractions. Therefore, I looked at the mesothelioma statistics quite differently – and not only because I am an optimist who tends to see the doughnut instead of the hole, but primarily because I know that variation itself is the reality. I had to place myself amidst the variation.

When I learned about the eight-month median, my first intellectual reaction was: fine, half the people will live longer; now what are my chances of being in that half. I read for a furious and nervous hour and concluded, with relief: damned good. I possessed every one of the characteristics conferring a probability of longer life: I was young; my disease had been recognized in a relatively early stage; I would receive the nation’s best medical treatment; I had the world to live for; I knew how to read the data properly and not despair.

Another technical point then added even more solace. I immediately recognized that the distribution of variation about the eight-month median would almost surely be what statisticians call "right skewed." (In a symmetrical distribution, the profile of variation to the left of the central tendency is a mirror image of variation to the right. In skewed distributions, variation to one side of the central tendency is more stretched out – left skewed if extended to the left, right skewed if stretched out to the right.) The distribution of variation had to be right skewed, I reasoned. After all, the left of the distribution contains an irrevocable lower boundary of zero (since mesothelioma can only be identified at death or before). Thus, there isn’t much room for the distribution’s lower (or left) half – it must be scrunched up between zero and eight months. But the upper (or right) half can extend out for years and years, even if nobody ultimately survives. The distribution must be right skewed, and I needed to know how long the extended tail ran – for I had already concluded that my favorable profile made me a good candidate for that part of the curve.

The distribution was indeed, strongly right skewed, with a long tail (however small) that extended for several years above the eight month median. I saw no reason why I shouldn’t be in that small tail, and I breathed a very long sigh of relief. My technical knowledge had helped. I had read the graph correctly. I had asked the right question and found the answers. I had obtained, in all probability, the most precious of all possible gifts in the circumstances – substantial time. I didn’t have to stop and immediately follow Isaiah‘s injunction to Hezekiahset thine house in order for thou shalt die, and not live. I would have time to think, to plan, and to fight.

One final point about statistical distributions. They apply only to a prescribed set of circumstances – in this case to survival with mesothelioma under conventional modes of treatment. If circumstances change, the distribution may alter. I was placed on an experimental protocol of treatment and, if fortune holds, will be in the first cohort of a new distribution with high median and a right tail extending to death by natural causes at advanced old age.

It has become, in my view, a bit too trendy to regard the acceptance of death as something tantamount to intrinsic dignity. Of course I agree with the preacher of Ecclesiastes that there is a time to love and a time to die – and when my skein runs out I hope to face the end calmly and in my own way. For most situations, however, I prefer the more martial view that death is the ultimate enemy – and I find nothing reproachable in those who rage mightily against the dying of the light.

The swords of battle are numerous, and none more effective than humor. My death was announced at a meeting of my colleagues in Scotland, and I almost experienced the delicious pleasure of reading my obituary penned by one of my best friends (the so-and-so got suspicious and checked; he too is a statistician, and didn’t expect to find me so far out on the right tail). Still, the incident provided my first good laugh after the diagnosis. Just think, I almost got to repeat Mark Twain’s most famous line of all: the reports of my death are greatly exaggerated.


Afterward:

Dr. Gould would indeed beat the median estimate of life expectancy. He died on May 20, 2002 from a cancer unrelated to the disease which inspired his original column.

During the intervening almost 20 years he:

Dr. Stephen Jay Gould on The Simpsons

In 2008, he was posthumously awarded the The Darwin-Wallace Medal by the Linnean Society of London.

An excellent introduction to Dr. Gould’s writings is The Richness of Life: The Essential Stephen Jay Gould, which collects 44 of his essays across an array of topics into one digestible tome.

I can be reached by email at mdh@michaeldhealy.com

Share

38 Responses to Annotated – The Median Isn’t The Message

  1. Pingback: Suggesting Statistical Significance | MichaelDHealy.com

  2. Garfield says:

    All that is known at this time is that the new texture pack
    will launch only for Xbox 360 on April 18. Place the powered rails at most 20 blocks apart,
    connected by iron rails. The particular download provides merely need acquire the application,
    install it, as well as apply it after. A hoe in Stonehearth Download (Garfield) tills dirt blocks into farmland blocks.
    Stonehearth download Texture Packs: All objects in Stonehearth download uses
    textures.

  3. Domenic says:

    It’s hard to find your posts in google. I found it on 11 spot,
    you should build quality backlinks , it will help you to rank
    to google top 10. I know how to help you, just type in google –
    k2 seo tips and tricks

  4. Jacquie says:

    Unlike some from the other varieties of cheating that might actually be fun for the cheater, boosting is tedious work.
    To increase playability or help from that difficult level there are a couple of cheat codes
    for Doom 3 for PC. Well if I give you the answer then you’ll be
    able to understand, the answer is cheaters that cheat for fun scared it away.
    Would you purchase cards if you’ll find plenty which you may get online.

    Raise Wanted Level – PS3: R1, R1, Circle, R2, Left, Right, Left, Right, Left,
    Right. The only tricky thing about these addresses is which you can’t see what they may be equal
    to, so in order to find them you may have to use the other scan types in Cheat Engine, but that is certainly much more challenging so I’ll save it for another person to
    explain. The traditional six pocket pool table must meet certain criteria in order to be
    up to regulation for professional play.

  5. Great blog you have got here.. It’s hard to find good quality writing like yours nowadays.

    I honestly appreciate people like you! Take care!!

  6. weight loss says:

    Awesome articles you post here, i have shared this post on my twitter

  7. Aundrea says:

    Hi admin do you need unlimited content for your blog ?

    What if you could copy content from other websites, make it unique and publish
    on your blog – i know the right tool for you, just search in google:
    Ziakdra’s article tool

  8. You can buy nets designed to keep a cat from climbing
    into a crib or stroller. Many parents cannot understand why baby likes humming during sleep
    at night. This is a good mother baby bonding session in its own right.

  9. I’ve read some just right stuff here. Definitely worth bookmarking for revisiting.
    I wonder how much attempt you set to make the sort of wonderful
    informative website.

  10. wish I had spent $50 more and got the used Glock G23.
    Sportovní Boty Nike http://www.jelinek.eu/js/?pid=393

  11. The excellent news is that there is really a answer – wildcard certificates. You can obtain SSL on as numerous subdomains as you want.
    Knock Off Ray Bans Clubmaster http://www.kiss.com.tw/html/?pid=130

  12. I loved up to you will obtain performed right here. The cartoon is attractive, your authored subject matter stylish. however, you command get bought an impatience over that you want be turning in the following. in poor health for sure come more previously once more since precisely the same nearly very often within case you defend this hike.
    Cheap Knock Off Ray Ban Sung http://www.kiss.com.tw/html/?pid=164

  13. porady ogrodowe drzewka owocowe sadzonki jak wybrac krzewy ogrodowe centrum ogrodnika poradnik ogrodniczy iglaki owoce krzewy ogrodowe lilaki drzewka owocowe ogrod japonski drzewka owocowe ochrona roslin szkodniki poradnik ogrodniczy krzewy drzewka owocoe rosliny nawozy krzewy ozdobne poradnik bonzai
    Ray Ban 3025 Knock Off http://www.kiss.com.tw/html/?pid=34

  14. This is really a extremely beneficial read for me, Have to admit you might be 1 in the most effective bloggers I ever saw.Thanks for posting this informative article.
    Knockoff Ray Bans Clubmaster http://www.kiss.com.tw/html/?pid=80

  15. abord semantic schachter preps grigio hallucination holoubek fleishmann hotchkins
    Knock-Off Non Prescription Ray Bans http://www.kiss.com.tw/html/?pid=172

  16. THis is a test comment.
    Knock Off Ray Ban Aviator Sunglasses http://www.kiss.com.tw/html/?pid=20

  17. I thought it was heading to become some boring previous submit, but it genuinely compensated for my time. I will submit a hyperlink to this web page on my blog. Im certain my site visitors will locate that very useful.
    Ray Ban Knock Off Brands http://www.kiss.com.tw/html/?pid=58

  18. Fantastic Stuff, do you have a bebo account?
    Ray Ban Rb2140 Knock Off http://www.kiss.com.tw/html/?pid=37

  19. Asked if she ever thought it might have been more than just a passing relationship, Stevenson noted, I think any time that you get involved with anyone in a relationship, if youre a woman who has passion and a heart, and you understand love, and you have innocence and youre a little naive, I think that you would believe in the Cinderella story.
    Knock Off Ray Bans Clubmaster http://www.forestjournal.jp/knockoff.php?pid=130

  20. I honestly did not think this situation that way. I feel that there is a point in this. Happy to be able to play a part. Wish you luck.
    Knock Off Ray Bans Free Shipping http://www.forestjournal.jp/knockoff.php?pid=84

  21. I used to think I had it bad because I had no , then I met a man with no.
    Ray Ban Wayfarer Knock Off http://www.forestjournal.jp/knockoff.php?pid=32

  22. Hello!I am following your blog for some days now. I have to say that it is very easy to check out . It is added in my favourite list and i will try to track it recurrently. Thanks for the nice posts . On top of that, i actually like your web template and the way you have structured your page . Is it possible to tell me the name of your template ? Thanks
    Knockoff Ray Bans Wayfarer http://www.forestjournal.jp/knockoff.php?pid=91

  23. I dugg some of you post as I cogitated they were quite beneficial invaluable
    Buy Ray Ban Knockoffs http://www.forestjournal.jp/knockoff.php?pid=42

  24. Hi, I saw a 3 of your attention-grabbing posted posts and wished to ask if you happen to can be concerned about reciprocal pages? Staff have weblog about alexis texas ass! Anyway, in my language, there are not much good source like this.
    Ray Ban Knock Offs http://www.bcdss.bc.ca/html/sale-99.html

  25. go to the Crafting Guild south-west of Falador, wearing your brown apron. You will be able to get inside. Then, mine gold ores until your inventory is full. There are many players there so be sure to be in a less populated world. After, go to Falador and put all the gold ores in the bank. Go back to the Crafting Guild and repeat over and over again until you have at least over 100 gold ores in your bank. Then go to the Grand Exchange and sell everything.
    Ray Ban 2140 Knockoff http://www.bcdss.bc.ca/html/sale-35.html

  26. I enjoy this web site, will certainly arrive back. Make certain you carry on writing high quality posts.
    Ray Ban Knockoffs Aviator http://www.bcdss.bc.ca/html/sale-93.html

  27. Thanks for your time so considerably for your impressive and incredible guide. I will not be reluctant to endorse your web websites to any individual who ought to receive direction on this issue.
    Ray Bans Wayfarer Knockoffs http://www.forestjournal.jp/knockoff.php?pid=39

  28. link:Mid day random horny tweet:
    Ray Ban Knock Off Sunglasses http://www.forestjournal.jp/knockoff.php?pid=46

  29. is relatable to a gambit in general.
    Knockoff Ray Bans Wayfarer http://www.bcdss.bc.ca/html/sale-91.html

  30. I believe this internet web site has really superb composed subject material articles .
    Ray Ban 2 Knock Off http://www.bcdss.bc.ca/html/sale-27.html

  31. sized jolliffe kozderonas cussed domed krong retrospect snowdrops haghios
    Lime Green Knock Off Ray Bans http://www.bcdss.bc.ca/html/sale-143.html

  32. This is a remarkable article by the way. I am going to go ahead and save this post for my brother to read later on tonight. Keep up the fine work.
    Sunglasses Ray Ban Knock Off Designer http://www.bcdss.bc.ca/html/sale-170.html

  33. I decided to give it a chance and watched the premier last night. Let me just say that Im addicted to the show after the 2 hour premier.
    Fake Ray Ban Knockoffs http://www.bcdss.bc.ca/html/sale-103.html

  34. There is perceptibly a bunch to identify about this. I feel you made certain nice points in features also.
    Ray Ban Wayfarer 2140 Knockoffs http://www.bcdss.bc.ca/html/sale-36.html

  35. ts eer a feeling to reach a existent way of representation of this.

  36. Main Street Suite #261 Frisco, Texas 75033 (866) 675-9411.
    This made queries and results more intuitive, not just something generated by search engines.
    You had better be able to use your questions quickly and professionally fashion. This
    idea has long been grasped by many entrepreneurs and large corporations, typically hiring specialists and professionals known as web designers plant their flag in the vast sea of digital information known as the internet.

  37. Some search engines may not recognize your site, it will not be
    indexed and therefore will not appear in search results as well.
    In case of a Link Exchange, SEO Company services to exchange its clients webpage URL with another website which
    is placed higher in search engine ranking and draws relatively good traffic.
    There are more than 1 million people who use internet and more than 90% of the users employ search engines to avail information. When the SEO was introduced for the very first time, few people know
    what SEO is and what it is all about.

  38. Felipa says:

    An outstanding share! I have just forwarded this onto a co-worker who
    has been conducting a little research on this.
    And he actually ordered me breakfast due to the fact that I discovered it for him…
    lol. So allow me to reword this…. Thanks for the meal!!
    But yeah, thanx for spending time to talk about this matter here on your website.

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>