How Good is Public Health Research?
Yesterday morning I had one of those experiences journalists dread: I opened up the Sunday New York Times and there on the front page of the Times Magazine was a story I've been kicking around. Titled "Do We Really Know What Makes Us Healthy?", the story by Gary Taubes is a thorough look at how so much scientific research in the name of public health gives us dodgy, even incorrect, results. Told through the vehicle of hormone replacement therapy, Taubes' story is really a discerning look at the purpose and limits of epidemiology - which is our best way of establishing what sort of behaviors and interventions might be good for us, and which might be bad. One thing I was expecting Taubes to mention was the killer study by John Ioannidis in the August 2005 issue of PLoS Medicine: "Why Most Published Research Findings Are False". This erudite bit of statistical analysis pointed out that one-off results are often wrong - in fact, are more likely to be false than true. One of the most downloaded papers PLoS has put out, it's the sort of clear, counter-intuitive and declarative paper that I wish was characteristic of more scientific research. I expect Taubes didn't get into it because it's full of talk of positive-predictive-vaules and power and bias. But still, if I had written the story - which I swear I had a version of on my to-do list - Ioannidis would've been on the source list.
Yesterday morning I had one of those experiences journalists dread: I opened up the Sunday New York Times and there on the front page of the Times Magazine was a story I've been kicking around. Titled "Do We Really Know What Makes Us Healthy?", the story by Gary Taubes is a thorough look at how so much scientific research in the name of public health gives us dodgy, even incorrect, results. Told through the vehicle of hormone replacement therapy, Taubes' story is really a discerning look at the purpose and limits of epidemiology - which is our best way of establishing what sort of behaviors and interventions might be good for us, and which might be bad. One thing I was expecting Taubes to mention was the killer study by John Ioannidis in the August 2005 issue of PLoS Medicine: "Why Most Published Research Findings Are False". This erudite bit of statistical analysis pointed out that one-off results are often wrong - in fact, are more likely to be false than true. One of the most downloaded papers PLoS has put out, it's the sort of clear, counter-intuitive and declarative paper that I wish was characteristic of more scientific research. I expect Taubes didn't get into it because it's full of talk of positive-predictive-vaules and power and bias. But still, if I had written the story - which I swear I had a version of on my to-do list - Ioannidis would've been on the source list.
Is Disease Resistance Genetic? Of Course, But...
Yesterday a story caught my eye titled "Disease Resistance May Be Genetic" that heralded a breakthrough study in Evolution about the inheritance characteristics of genes conferring resistance to infectious disease. It sounded like a perfect link for Epidemix (even though, curiously, the study actually came out in the June issue). But as I began to write it up, I kept stumbling over the headline. Didn't we already know that disease resistance may be genetic? I'm no geneticist, nor an infectious disease expert, but I did know that sickle cell anemia - which confers resistance to malaria - and other resistant traits were genetic and thus inherited conditions. And since the journal is not open access, I could only check out the journal's press release and the abstract, which didn't clarify matters at all.So I dropped a note to the study's author, Paul Schliekelman, a statistician at the University of Georgia. And I'm very glad I did. He kindly explained the actual import of his work and it's very cool. Here's the thread:
Yesterday a story caught my eye titled "Disease Resistance May Be Genetic" that heralded a breakthrough study in Evolution about the inheritance characteristics of genes conferring resistance to infectious disease. It sounded like a perfect link for Epidemix (even though, curiously, the study actually came out in the June issue). But as I began to write it up, I kept stumbling over the headline. Didn't we already know that disease resistance may be genetic? I'm no geneticist, nor an infectious disease expert, but I did know that sickle cell anemia - which confers resistance to malaria - and other resistant traits were genetic and thus inherited conditions. And since the journal is not open access, I could only check out the journal's press release and the abstract, which didn't clarify matters at all.So I dropped a note to the study's author, Paul Schliekelman, a statistician at the University of Georgia. And I'm very glad I did. He kindly explained the actual import of his work and it's very cool. Here's the thread:
EPIDEMIX: Coverage of your research gets the headline: "Disease Resistance May Be Genetic" - but didn't we already know that (sickle cell anemia, for instance)? Am I missing something, or is there a greater significance here?
SCHLIEKELMAN: You are right, this was already well known and not at all the point of the paper. I will give a try at a simple (if not short) explanation:
1) Disease resistance is well known to have a strong genetic component.
2) Suppose that a new mutation appears in a population that gives resistance to some potentially fatal infectious disease. Initially it will be rare in the population. The question that we are interested in is how quickly will it spread through the population. Understanding this will help us understand the evolutionary history of disease resistance genes such as the CCR5 locus that confers resistance to HIV.
3) Although initially rare in the population overall, it will be common within some families. This is because if a parent is carrying a copy then his/her childen will each have a 1/2 chance of also carrying it. Most of the time, if you see one copy in a family you will see others.
4) We have a strong tendency to catch infectious diseases from our family members (if you have children you will know this personally). Therefore, if I have a gene that makes me less likely to become infected then it is beneficial to my entire family. This is because if I am less likely to get sick then my family members are less likely to catch something from me. Likewise, if any of them have the same gene, it makes me less likely to get sick.
5) Therefore, the resistance genes in a family all boost each other and the intensity of natural selection in their favor is thereby magnified. Kin selection is the name for the general phenomenon of genes in one individual benefitting genes in his/her relatives (hence the title of the paper: "Kin Selection and Evolution of Infectious Disease Resistance").
In the paper I used a mathematical model to explore this effect and determine how important it is. The answer, as often is the case, is "it depends". The effect can be quite dramatic, increasing the strengh of selection by as much as two to three times. However, in other situations the effect is fairly small (e.g. 10-20%). The difference results from what you assume about how the resistance gene affects transmission probability. I would be happy to explain this further if you are interested. However, my answer is already rather long-winded so I will cut it off here.
EPIDEMIX: Is it right that one takeaway is that resistance to one disease is good for a family's entire genepool - that is, by being resistant there's a greater likelihood the entire family-line will flourish?
SCHLIEKELMAN: I would put it like this: When the resistance gene is rare then resistance will tend to be clustered in families. This means that to some degree families become the unit of natural selection rather than individuals. All of the genes in the family receive a selective boost rather than just the genes in an individual.
So that's much more clear. The network effects of immunity are particularly intriguing to me. And I love the multidisciplinary nature of the work: This is a statistician doing genetics with public health import. And here's the capper: Schliekelman got the idea for the study after he kept catching stomach flu from his young daughters.
The Popcorn Problem
The Pump Handle has a scathing and rather startling rundown on the risk of microwave popcorn, specifically a butter-flavoring chemical called diacetyl, and federal regulators' failure to act to protect consumer health. The anecdotes in the comments are especially disconcerting. Makes me glad we've never owned a microwave (until last month). A great testament to the power of informed blogging.
The Pump Handle has a scathing and rather startling rundown on the risk of microwave popcorn, specifically a butter-flavoring chemical called diacetyl, and federal regulators' failure to act to protect consumer health. The anecdotes in the comments are especially disconcerting. Makes me glad we've never owned a microwave (until last month). A great testament to the power of informed blogging.
Aliens and the Venter/Watson Genomes
All the Venter hubub today reminds me of a scenario that Oliver Morton offered at SciFoo:
Imagine the human race is wiped out. Aliens come down from the sky, and want to see who these humans were. All they'd have to go on would be the DNA of Craig Venter and James Watson. So at best, they could come up with a floc of Venter and Watson clones. Oy.
All the Venter hubub today reminds me of a scenario that Oliver Morton offered at SciFoo:
Imagine the human race is wiped out. Aliens come down from the sky, and want to see who these humans were. All they'd have to go on would be the DNA of Craig Venter and James Watson. So at best, they could come up with a floc of Venter and Watson clones. Oy.
Bipolar Syndrome: When Is a Disease Real?
Much frenzy about the rapid increase in diagnoses for bipolar syndrome in children. A new study in the Archives of General Psychiatry shows that there's been a 40-fold increase in diagnoses over the past decade or so, with now fully 1 percent of all children being labeled "bipolar." According to the DSM IV, the textbook for mental health and disease classification, bipolar disorder is a mood disorder characterized by manic episodes and major depressive episodes. The diagnosis is controversial because of familiar riddle of epidemiology: Either the illness was underdiagnosed for decades, and we are now identifying a previously-hidden epidemic. Or the illness is being overdiagnosed, as a condition already of flimsy status in adult populations gets extended into children. As it happens, I was speaking last week with a prominent psychiatrist who was involved in the crafting of the DSM IV. First characterized bipolar disorder in children as one of the two "major issues"* in the psychiatric community and in the crafting the new edition of the diagnostic manual. The issue is how applicable is the disorder to children, in whom mental health can be far more variable and transitory.
Much frenzy about the rapid increase in diagnoses for bipolar syndrome in children. A new study in the Archives of General Psychiatry shows that there's been a 40-fold increase in diagnoses over the past decade or so, with now fully 1 percent of all children being labeled "bipolar." According to the DSM IV, the textbook for mental health and disease classification, bipolar disorder is a mood disorder characterized by manic episodes and major depressive episodes. The diagnosis is controversial because of familiar riddle of epidemiology: Either the illness was underdiagnosed for decades, and we are now identifying a previously-hidden epidemic. Or the illness is being overdiagnosed, as a condition already of flimsy status in adult populations gets extended into children. As it happens, I was speaking last week with a prominent psychiatrist who was involved in the crafting of the DSM IV. First characterized bipolar disorder in children as one of the two "major issues"* in the psychiatric community and in the crafting the new edition of the diagnostic manual. The issue is how applicable is the disorder to children, in whom mental health can be far more variable and transitory.
The big takeaway from my conversation with this psychiatrist was what he described as the "major problem" with the popular perception of the DSM. "People forget that these aren't real diseases," he said. "These are man made diseases. We're just describing symptoms, we don't really know what's going on inside."
This, of course, is a major difference between mental health diagnoses - which are efforts to describe symptoms as we see them - and pathological diagnoses - which are attempts to discern molecular and cellular processes inside the body. I wish more effort was made to make this point clear, among the menta-health community as well as among the media. This New York Times story does a nice job of referring to bipolar disorder as a "label", but it's surprising to me that there's not more of an effort to explain the relativistic nature of this label (particularly for an article that's really about the mushiness of mental health diagnoses). And as medicine starts to adopt this practice of diseases more conceptual than physical, I think this distinction must be maintained.
Interestingly, there's one major exception to the "man-made" nature of the DSM - sleep disorders, which can be understood and, more importantly, measured in physical terms
* The other being a sort-of flip side illness, Adult Attention Deficit Disorder, which represents a childhood condition being extended to adults.
James Watson's Genome, Annotated
One of the coolest things from SciFoo was a presentation by Lincoln Stein of Colds Springs Harbor Lab. Lincoln is an intriguing guy, a computational biologist who is extremely handy with code.
One of the coolest things from SciFoo was a presentation by Lincoln Stein of Colds Springs Harbor Lab. Lincoln is an intriguing guy, a computational biologist who is extremely handy with code.
Stein's presentation was titled something like: "Genomic Voyeurism". He had spent the previous week (just one week!) whipping up a little website called the James Watson Genome Browser. Stein matched Watson's genome, which was made public on May 31, to the reference genome from the Human Genome Project. He also input data from the Human HapMap Project, which indicates the position of common polymorphisms in the human genome, and OMIM associations that list so common genomic variants associated with disease risk.
The result is a Genotype Viewer that lets you scan Watson's sequence to see where his genome differs from the "reference" sequence, as well as to view some genes and potential disease associations. As Stein introduced the Browser, he made the point that this is almost entirely an academic scan, not a clinical one - at nearly 80, Watson has pretty much had happen whatever's gonna happen to him. That is, whatever risks he might have, he's clearly beat the odds.
The browser is not an easy thing to navigate - most of the information in it is over my head, and scanning page by page or mousing over the popups, it's a bit difficult to make sense of what exactly the genome is telling you. But there's a nifty search function that lets you, say, enter a gene with a known association (Stein suggests trying "HTR2A") and seeing whether Watson has said gene.
What's amazing about this is that 1) Stein did this in a week and that 2) it's the first time I've seen a hint at what information lies inside a genome on a practical level. As I say, it's a mite impenetrable for the non-geneticist, but it does open the window onto all of our genetic futures.
[Duncan Hull has a thorough play by play of Stein's talk here.]
Friday Fanboy: Look Over to Dover
I've long been a fan of Dover Books, the no-frills publisher of reissued and public-domain texts. The books are typically high quality - each book has an endpage with this text:
A DOVER EDITION DESIGNED FOR YEARS OF USE We have made every effort to make this the best book possible. Our paper is opaque, with minimal show-through; it will not discolor or become brittle with age. Pages are sewn in signatures, in the method traditionally used for the best books, and will not drop out, as often happens with paperbacks held together with glue. Books open flat for easy reference. The binding will not crack or split. This is a permanent book.
I've long been a fan of Dover Books, the no-frills publisher of reissued and public-domain texts. The books are typically high quality - each book has an endpage with this text:
A DOVER EDITION DESIGNED FOR YEARS OF USE We have made every effort to make this the best book possible. Our paper is opaque, with minimal show-through; it will not discolor or become brittle with age. Pages are sewn in signatures, in the method traditionally used for the best books, and will not drop out, as often happens with paperbacks held together with glue. Books open flat for easy reference. The binding will not crack or split. This is a permanent book.
What a wonderful ethos.
What I especially appreciate is how any time I want to go deep into the history of a subject, there's bound to be a trove of Dovers that will catch me up. So when I indulged in New York City architectural history, Dover has terrific books on NY bridges, the 1939 World's Fair, and a book on the city's architectural holdouts (the recalcitrant landowners who refuse to sell to the big developer, and thus get built around with remarkable consequences - see some examples here).
What's this have to do with public health? Well, needless to say, their catalog of books on medicine and public health is a joy to peruse. They have John Hooke's Micrographia, the 1665 work that helped establish the microscope as a tool for medicine. There's Florence Nightingale's Notes on Nursing. Malthus's Essay on the Principle of Population. Henry Mayhew's great study of the London Underworld, circa 1840.
If you have a jones for history and esoteric knowledge, you could do worse than to buy a couple boxes of Dover books and spend a Sunday flipping through them.
What Do China's Scandals Mean For Public Health?
Given the recent spate of stories about the risks to public health coming from Chinese factories - toys, and dog food and pharmaceuticals and sea food and pigs - I've been waiting for someone to write a definitive story on the public health lessons to be learned. But since nothing definitive has been forthcoming - aside from the very good but incremental reporting in the NYTimes and elsewhere, which is more about global politics than public health - I figure it's just as well that I throw down a few conclusions. 1) Regulation is a good thing. Government oversight of trade products - especially those that impact public health - are essential. Establishing clear standards for, say, the presence of lead in children's toys - and then having the governmental appartatus in place to enforce such regulations is not just important, but essential for the US. The fact that the US has recently reduced its funding for FDA inspection and other threshhold checks on imports is the opposite of what the government should be doing.
Given the recent spate of stories about the risks to public health coming from Chinese factories - toys, and dog food and pharmaceuticals and sea food and pigs - I've been waiting for someone to write a definitive story on the public health lessons to be learned. But since nothing definitive has been forthcoming - aside from the very good but incremental reporting in the NYTimes and elsewhere, which is more about global politics than public health - I figure it's just as well that I throw down a few conclusions. 1) Regulation is a good thing. Government oversight of trade products - especially those that impact public health - are essential. Establishing clear standards for, say, the presence of lead in children's toys - and then having the governmental appartatus in place to enforce such regulations is not just important, but essential for the US. The fact that the US has recently reduced its funding for FDA inspection and other threshhold checks on imports is the opposite of what the government should be doing.
2) Regulation isn't a solution. Conservatives often paint government regulation as a symptom of leftist, if not socialistic, tendencies. But - hey! - here's a reality check: China is a communist country and they CLEARLY have terrible regulatory enforcement. And on this side of the ocean, it's not acceptable to have rules against lead content or contaminated meat or what have you - we also must have a robust surveillance and detection infrastructure that lets us detect stuff that's bad before it's on our shores. This isn't a technology issue - there are great scanning and sensor devices available that could enable smart and early detection of banned substances or potentially infectious diseases. We just need a policy that privileges those technologies, rather than parades them as panaceas.
3) Global trade is messy. There are all sorts of products out there that we don't know really what they're made of or where they come from. Trust is a huge issue. China is a big toss-up here. The upside of trust: China wants to produce goods for the US market. The downside: if they give the US bogus goods, the US will overreact and ban lots of Chinese goods. Finding the right balance - between where China's access to the US market matches our trust and appetite for their goods - is tenuous, and if safety concerns persist, that see-saw will continue to waver.
4) Global health via trade is disgusting. It may be okay to let that balance waver and wander as far as free trade concerns. It is unacceptable to allow it to waver insofar as health is concerned. We cannot allow a 'free market' to find the balance of acceptable losses for dangerous goods. The US needs to clearly articulate and enforce importation laws that put the onus on dangerous goods entirely on the exporting nation.
5) Don't be an official in China. Odds are you'll wind up dead, one way or another.
Free Antibiotics!
Wow. I totally missed this last week: Publix, a Florida-based chain of super markets, announced last week that it was offering free antibiotics. With a prescription, of course. But still - this is pretty appalling. I mean, antibiotics are way overprescribed as it is, for just about any condition they're used for (check out a simple Google search for proof), so the fact that Publix is fomenting that misuse is, well, kinda craven. So much for the fight against antibiotic resistance, at least in Florida...
Wow. I totally missed this last week: Publix, a Florida-based chain of super markets, announced last week that it was offering free antibiotics. With a prescription, of course. But still - this is pretty appalling. I mean, antibiotics are way overprescribed as it is, for just about any condition they're used for (check out a simple Google search for proof), so the fact that Publix is fomenting that misuse is, well, kinda craven. So much for the fight against antibiotic resistance, at least in Florida...
Google and Microsoft Enter Health Care (?)
All I have to say about this NYTimes story about Google's and Microsoft's approaches to health care is: What the heck does this story actually have to say about the future of health care? And considering they've seen the Google prototype, it seems awfully thin on actual content about what these companies' forays might consist of...
All I have to say about this NYTimes story about Google's and Microsoft's approaches to health care is: What the heck does this story actually have to say about the future of health care? And considering they've seen the Google prototype, it seems awfully thin on actual content about what these companies' forays might consist of...