More buzz over the Indian malaria estimates

On March 23, 2011, in India, malaria, measurement, by Karen Grepin

Last fall, I blogged about a seemingly alarming new research findings published in the Lancet by Dhingra and co-authors that claimed that the estimates of mortality from malaria in India were being underreported by a factor of 10. I like many others, asked how could the WHO’s estimates be so wrong?

Five months later, it seems that this controversy is still buzzing away (mosquito pun intended). The Lancet recently published a series of correspondences have seriously questioned the validity of these newly published estimates and have left me scratching my head once again.

I was particularly troubled by some of the arguments made by Naman Shah and co-authors (you may know Naman from his excellent malaria blog topnamen). Apparently a small validation exercise had been carried out in India to validate the use of the verbal autopsy methods used in this study but the validation exercise found large discrepancies between what was being counted as a malaria death using verbal autopsy methods and what was being clinically validated in hospitals. I saw the same data presented last week at the GHME conference in Seattle which makes me believe that this is a really big faux pas in the health metrics world.

So while I am no expert on these things, I am surprised that if one is using a new method and that there is data available from a validation exercise that shows large discrepancies that these limitations would not become apparent during the peer review process – in particular given how much controversy there is about the use of verbal autopsy methods in general and in particular regarding the use of them in other geographic contexts for malaria.

It is great to have new methods to track and monitor things that have been challenging to measure in the past, but as we all know, newer is not always better, and I believe that new methods need to demonstrate their superiority before we take them at face value. This might be one case where we might need a bit more convincing.

Share on Facebook

4 Responses to “More buzz over the Indian malaria estimates”

  1. naman says:

    thanks Karen, if the discrepancies from the validation study (which was conducted by the study authors themselves) did not become apparent during peer review it was because there was no mention of the study or its results in the paper in spite of their clear relevance.

  2. Meredith says:

    In addition to what naman said, it also means that the peer reviewers chosen by the journal were not independently aware of the validation study.

    That said, as a peer reviewer, I would have asked whether there had been any validation studies, required that if there had then they be included in the paper, and if there hadn’t then required that the conclusions section include a discussion of this very significant limitation. However, I’m a biostatistician and have run validation studies, so it’s something that’s always in the back of my mind – sadly, that is not true of many, if not most, clinical reviewers.

  3. API_Health says:

    More buzz over #India's #malaria estimates

Leave a Reply

Analytics Plugin created by Web Hosting