Multivitamins in the Prevention of Cancer in Men

Yesterday a new article was published in the prestigious Journal of the American Medical Association, JAMA. As a statistician, I find the fact that this article is published in such a prestigious journal in its current format somewhat surprising and definitely disturbing.

The key result that is noted in the article is the fact that male physicians taking multivitamins seem to develop less cancer than similar male physicians taking a placebo.  In the multivitamin group, 1290 of 7317 (17.6%) subjects developed cancer, compared to 1379 of 7324 (18.8%) subjects in the placebo group.  The difference is 1.2%, with a 95% confidence interval of [-0.05%, 2.45%] (note that my simple calculation of the difference in proportion is not statistically significant, compared with the survival analysis in the manuscript).

The issue I have with the paper is one of multiplicity.  A simple comparison with the planned objectives and analyses of the study in indicate that there were 3 primary objectives of this study.  There is additionally 4 secondary objectives stated, one of which is whether multivitamins reduces the risk of cancer.  It seems fair to conclude that since the publication is addressing one of the secondary endpoints, then all seven outcomes were considered in the study.  It is not entirely clear from the publication how many of the seven outcomes were statistically significant at the 5% level.  The stated p-value is 0.04 for the main analysis in the publication.  This must be interpreted in the light of all of the planned analyses in the study.  A p-value of 0.04 is an indication that the probability of seeing this result if there is no actual difference between treatments is one in twenty-five.  However, if there were 7 such analyses, then the probability of observing at least one result as impressive as that reported would be much less, possibly as low as one in four (i.e. quite likely).

To make matters worse, the authors have also reported adverse events based on statistical significance tests.  I assume with such a large group of patients that there would have been a multitude of different types of adverse events reported (100s?).  Were all of these different event types tested?  In that case, it would be expected that you would find many statistically significant differences, just by chance (a significant result is only an indication that you would find such an extreme observation one in twenty times).

It is clear that this publication would not have demonstrated a clinically significant result if the fact that the study had so many objectives was taken into account.  As such, the conclusions that the study makes should not be conclusive, and in my opinion, should not encourage anyone to take multivitamins to avoid development of cancer.  I would however, highly recommend this paper to those in universities teaching statistics as a case study in what not to do.


Elton John’s Winter Ball

I am waking up disappointed this morning. One of the highlights of last night’s Winter Ball to raise funds for Elton John AIDS Foundation was meeting Matthew Cain, the arts correspondent for Channel 4. I chatted with Matthew, and he was warm and funny, complaining about the lack of eligible single men. When I pointed out that the waiters were all 6ft 3 models, he responded by telling me he’d just wasted 20 minutes chatting one up to find out he’s straight.

The ball was a glittering success. Everyone seemed to be enjoying themselves (we’ll, maybe apart from the couple who were arguing about whether she should have given David Furness her business card). The cocktails, provided freely by Grey Goose were a taste bud sensation.

Emeli Sande started off the entertainment, giving us a few songs before being joined by Labrinth, who got the crowd rocking. His set was excellent, a mix of pop, urban dance and electronica. Emeli watched on, sipping a glass of red wine whilst happily agreeing to be photographed by all.

The night progressed to the poolside dance floor (the pool was electronically projected, Club Tropicana style). A few of the girls and gays were pole dancing around one of the columns. People, including me, were throwing shapes on the dance floor.

Here’s where my disappointment lies. Matthew tweeted that there were a bunch of rich white men who couldn’t dance. Is he including me in this? Surely not?!

He was right about the lack of eligible men though. What was surprising was the number of hopeful single girls there. Bit of advice to them… If you’re looking for a (rich?) husband, Elton John’s parties might not be the best place.

And so, until next year…