Social media: More likely to identify bad medicines — or tarnish good ones?

Every week, it seems, I come across a new story about data analysts proposing to mine data from either medical records or social media to identify potential new harmful drug side effects; often, it is asserted that the methodology could have been used to successfully identify, at an early stage, the concerning effects of Vioxx.

I worry about us heading down this road - but perhaps not for the reasons you might think.

Many cynically assume that drug developers (like me) would resist such a surveillance system because it could unexpectedly result in the withdrawal of a marketed drug, costing a company millions in lost sales.

In fact, I suspect most drug developers (like me) would thrill, positively thrill to the prospect of a robust system of post-marketing surveillance that would enable rare but important side-effects to be captured accurately and responded to quickly.  No one wants to develop harmful products.

Many hurdles drug developers now face reflect the limited faith some regulators place in such post-marketing surveillance; initiatives such as the Sentinel program reflect the commitment of regulators to get this done right.

Bottom line: a robust surveillance system could make drug development faster, cheaper, and safer - a win for all stakeholders involved.

A robust surveillance system might even have an additional upside - the opportunity to detect the unexpected positive effects of drugs; such observations have played a critical role in the discovery of many important classes of drugs (especially for neuropsychiatric conditions), and it would be powerful to search for such opportunities more systematically, as discussed here.

Nevertheless, I'm concerned by some of the surveillance analytics about which I've been reading; I worry not about the sensitivity of these approaches - their ability to detect a true signal - but rather the specificity - their ability to accurately recognize the lack of a true signal.

I suspect many emerging approaches are so intensively focused on improving (and reporting) their sensitivity ("we could have found Vioxx!") that they may be neglecting to think through the consequences of an approach that has relatively poor specificity, and detects "signals" that aren't there.  Similar to the problems faced in the hospital (especially in the ICU) by constantly beeping warnings, an element of alarm fatigue develops, and you may start discounting all warnings - including, unfortunately, the real ones.

By itself, the problem of sensitivity and specificity could probably be solved through appropriate selection of cutoff criteria, and optimizing the analytics.  The real problem comes when you start to factor in the effects of social media (an emerging issue in medicine).

As Reddit recently and painfully demonstrated (nicely reported by The Atlantic's Alexis Madrigal), false information can spread on social media like wildfire, reinforcing Iago's awful, prescient observation, "Trifles, light as air/Are to the jealous confirmations strong/As proof of holy writ."

The continued popularity of the anti-vaccine movement (despite the discrediting of Andrew Wakefield - see this recent informative discussion by Phil Plait in Slate), and the remarkable sales of books such as "Natural Cures ‘They' Don't Want You To Know About" (see this NYT takedown of author Kevin Trudeau) emphasize the power of suspicion and rumor to impact perceptions of health and disease.

Next, think about what happens when you layer in the "nocebo effect" - discussed with characteristic grace by the New Yorker's wonderful new science blogger Gareth Cook here.  As Cook explains,

"With placebos (‘I will please' in Latin), the mere expectation that treatment will help brings a diminution of symptoms, even if the patient is given a sugar pill. With nocebos (‘I will harm'), dark expectations breed dark realities. In clinical drug trials, people often report the side effects they were warned about, even if they are taking a placebo."

As Cook adds, "The nocebo effect is not confined to clinical trials."

So here's the dilemma - on the one hand, powerful new big data approaches enable smart researchers to identify important faint signals, though they may often mistake noise for signal.  On the other hand, powerful social media technologies provide new opportunities for the profound amplification of spurious signals, leading to their mischaracterization.

As we progressively gain our footing here, we'll learn how to sort this out all.  Let's hope that important new medicines  are not erroneously discarded along the way.

 

Also Visit
AEIdeas Blog The American Magazine
About the Author

 

David
Shaywitz
  • Dr. Shaywitz trained in internal medicine and endocrinology at MGH, and conducted his post-doctoral research in the Melton lab at Harvard. He gained experience in early clinical drug development in the Department of Experimental Medicine at Merck, then joined the Boston Consulting Group’s Healthcare and Corporate Development practices, where he focused on strategy and organizational design. He is currently Director of Strategic and Commercial Planning at Theravance, a publicly-held drug development company in South San Francisco. He recently wrote Tech Tonics: Can Passionate Entreprenuers Heal Healthcare With Technology? 

  • Email: davidshaywitz.aei@gmail.com

What's new on AEI

image The money in banking: Comparing salaries of bank and bank regulatory employees
image What Obama should say about China in Japan
image A key to college success: Involved dads
image China takes the fight to space
AEI on Facebook
Events Calendar
  • 21
    MON
  • 22
    TUE
  • 23
    WED
  • 24
    THU
  • 25
    FRI
Wednesday, April 23, 2014 | 12:00 p.m. – 1:30 p.m.
Graduation day: How dads’ involvement impacts higher education success

Join a diverse group of panelists — including sociologists, education experts, and students — for a discussion of how public policy and culture can help families lay a firmer foundation for their children’s educational success, and of how the effects of paternal involvement vary by socioeconomic background.

Event Registration is Closed
Thursday, April 24, 2014 | 12:00 p.m. – 1:30 p.m.
Getting it right: A better strategy to defeat al Qaeda

This event will coincide with the release of a new report by AEI’s Mary Habeck, which analyzes why current national security policy is failing to stop the advancement of al Qaeda and its affiliates and what the US can do to develop a successful strategy to defeat this enemy.

Friday, April 25, 2014 | 9:15 a.m. – 1:15 p.m.
Obamacare’s rocky start and uncertain future

During this event, experts with many different views on the ACA will offer their predictions for the future.   

No events scheduled this day.
No events scheduled this day.
No events scheduled this day.
No events scheduled this day.
No events scheduled this day.