Former medical journal editor details why doctors can’t rely on medical literature for valid and reliable information

Some of you may have noticed that there has been a move in healthcare towards evidence-based medicine. And at least part of this concerns basing treatment regimes and recommendations on what scientific evidence appears to show. A big chunk of medical research is devoted to the gauging the effectiveness of pharmceutical drugs. And if we have a few trials which show that, say, drug X is effective for some a condition, then our doctors can confidently recommend it to their patients, often with the blessing of our governments and health agencies.

But how much can we trust the evidence on which health decisions are so often based? In this week’s edition of the Journal of the American Association, a former editor of the New England Journal of Medicine details in excruciating details the myriad of ways in which pharmaceutical companies can conspire to produce results that make their products look better and safer.

The author, Marcia Angell, starts by writing about how the drug company Merck manipulated data in two studies in an effort to mask the increased mortality associated with its drug rofecoxib. Let’s not sugar-coat the likely effect of this subterfuge: people died (unnecessarily).

Angell goes on to lament how prior to the 1980s, that when industry funded research, it was still the doctors and scientists conducting the research who were responsible for designing the study, analyzing and interpreting the data, as well as its writing up. Now though, all to often drug companies are initimately involved in all of these processes, to the extent that sometimes study authors may not even have access to all the data the study generated.

Part of the problem here, according to Angell, is that academic research centres now have to compete with what are known as contract research organisations (companies specialising in patients for clinical trials through a network of doctors). Contract research organisations are often only too happy to agree to the conditions dictated by those who pay them (the drug companies). Now, it seems, many academic medical centres are prepared to do the same or risk not getting the research bucks in.

It goes deeper than this, though, because as Angell points out, many academic centres have financial links with the drug companies whose products they assess. According to Angell, a recent review found that about two-thirds of academic medical centers hold equity interest (shares) in companies that sponsor research within the same institution. ,And a study of medical school department chairs found that two-thirds received departmental income from drug companies and three-fifths received personal income. In addition to grant support, study investigators often have other financial ties to the sponsors of their research, such as being paid consultants and members of advisory committees as well as sometimes having shares in company whose products they test.

Angell goes on to write: Given the conflicts of interest that permeate the clinical
research enterprise, it is not surprising that industry-sponsored research has consistently been shown to favor the sponsor’s drug”partly because negative results are often not published, partly because positive results are repeatedly published in slightly different forms, and partly because a positive spin is put on even negative results.

She cites examples too such as the study (reported here) which showed that
74 clinical trials of antidepressants found that 37 of 38 positive studies were
published, while 33 of 36 negative studies were either not published or were somehow portrayed in a positive light.

Angell also describes what a number of techniques that drug companies and scientists can use to help ensure studies produce the results the drug companies want. These include:

Comparing a drug to a competitor drug which is used a too low a dose (to make the sponsor’s drug look for effective)

Comparing a drug to a competitor drug which is used a too high a dose (to make the sponsor’s drug look safer)

Comparing a drug to placebo when it would be more appropriate to assess whether it works better than an existing drug

Choosing lots of different outcomes to measure and then selecting the best results for publication and highlighting

And then Angell asks questions of the independence of the professional and governemental organizations who we trust to set medical practice guidelines. In a study of more than 200 panels that issued practice guidelines, more than a thrd of the authors acknowledged that they had some financial interest in the drugs they recommended. She also mentions specifically the fact that of the 9 members of the National Cholesterol Education Program responsible for the latest (ever lower) cholesterol recommendations, 8 had financial ties to companies that make cholesterol-reducing statins. I mentioned this sorry state of affairs in a recent blog here.

Angell goes on to say : Looking at this picture altogether, it would be naive to
conclude that bias is only a matter of a few isolated instances. It permeates the entire system. Physicians can no longer rely on the medical literature for valid and reliable information. This is the conclusion I reluctantly reached toward the end of my 2 decades as an editor of the New England Journal of Medicine, and it has been reinforced in subsequent years. Clinicians just do not know anymore how safe and effective prescription drugs really are, but these products are probably nowhere near as good as the published literature indicates.

And after this sad indictment of the state of academic medical research Angell goes on to lament the fact that the biased literature it gives us causes doctors to practice a very drug-intensive style of medicine. Angell adds: Even when lifestyle changes would be more effective, physicians and their patients often believe that for every ailment and discontent there is a drug. Physicians are also led to believe that the newest, most expensive brand-name drugs are superior to older drugs or generics, even though there is seldom any evidence to that effect because sponsors do not usually compare their drugs with old drugs at equivalent doses. And finally, physicians learn to use drugs for off-label uses without good evidence of effectiveness. Although it is illegal for companies to market drugs for off-label uses, faculty thought leaders on company speakers’ bureaus regularly promote off-label uses in the guise of education or research.

Angells round off by suggesting that it is absurd to expect investor-owned drug companies to produce unbiased evaluations of their own products. And of course she’s right. And she’s right about another thing too when she suggests that reform of the system is required not just for the sake of appearances, but because it is a matter or public health.


Marcia Angell. Industry-Sponsored Clinical Research – A Broken System. JAMA 2008;300(9):1069-1071.

8 Responses to Former medical journal editor details why doctors can’t rely on medical literature for valid and reliable information

  1. Robin 5 September 2008 at 5:29 pm #

    This is such an important piece by Marcia Angell. Once you’ve spent some time reading round on a variety of medical issues, it doesn’t take very long before you realise the awesome power of the drug companies.

    I’ve come to the conclusion that most GPs, most of the time, just trot out Government-proposed targets (cholesterol is an obvious area) which are themselves the product of careful and well-funded lobbying by the drug companies.

    The latest targets for cholesterol fly in the face of the evidence from a range of studies, but you really have to dig deep and read people like Malcolm Kendrick. There are some interesting videos from him on YouTube.

  2. Faz 5 September 2008 at 9:41 pm #

    Excellent article!

    I wonder how much exposure this gets in the mainstream media. A Google News phrase match for “Marcia Angell” returns just 16 hits. Well, it’s not as if mainstream media is massively biased or anything.

  3. Methuselah - Pay Now Live Later 6 September 2008 at 6:04 pm #

    Thanks for this post – really brings home the true scale of the mess we have got ourselves in. The fundamental problem is the mixing of public health with profit. As the film ‘The Corporation’ shows, companies will if unchecked, behave in the manner of a sociopath. When companies can, by their actions, directly affect whether people live or die, regulation to check this behaviour must be stringent; yet because it has not been stringent and because the drug companies have become so powerful we now face the kind of interminable battle still being waged with tobacco companies. When big money can keep a bandwagon like that rolling for so long, what hope have we against companies whose products (ostensibly) are designed to improve health?

  4. Neil 6 September 2008 at 7:56 pm #

    The system is truly broken beyond being fixed by proper disclosure of conflicts of interest. You have to look at when the science used to be trustworthy as detailed by Marcia Angell, to see that the solution lies in restablishing the true independence of research.

  5. Pete 7 September 2008 at 8:02 pm #

    This is the weakness of research funded by any corporation, indeed of any ‘health’ product produced for profit. The bigger question is that, in varying degrees this applies to all studies, so where does that leave John’s advice, which seems to be based on published studies of one kind or another…..I can see the pressure profit brings or the corruption of individual ambition, but why a government plot?


  1. Vart är vi på väg? « Fatlies - FETA LÖGNER - 6 September 2008

    […] medicinsk tidskrift har att säga om den genomkorrupta läkemedelsindustrin, t ex i ett referat på Dr Briffas blogg. Alla de här frågorna handlar om människors liv, och om att människor tvingas leva ovärdiga […]

  2. fetsmart » Blog Archive - 13 September 2008

    […] sista ämne vill jag gärna tipsa om två bloggningar av en av mina favoritbloggare Dr John Briffa, “Former medical journal editor details why doctors can’t rely on medical literature for vali… och “Letter in BMJ draws our attention to profiteering by the pharmaceutical […]

  3. fetsmart » Blog Archive » Dagens bloggtips: Zac och Briffa - 13 September 2008

    […] sista ämne vill jag gärna tipsa om två bloggningar av en av mina favoritbloggare Dr John Briffa, “Former medical journal editor details why doctors can’t rely on medical literature for vali… och “Letter in BMJ draws our attention to profiteering by the pharmaceutical […]

Leave a Reply