Journals give more publicity to ‘weak science’

Analysis of seven prominent medical journals finds randomised controlled trials are far less likely to receive a press release than weaker observational studies

January 13, 2016
Aged medical journals on shelf

Scientists often bemoan journalists’ shoddy reporting of research findings. The writer and physician Ben Goldacre has even made a career dissecting shaky scientific claims that appear in British newspapers.

But a new study suggests that scientifically illiterate hacks in desperate need of a story might be only partly to blame. It found that journals themselves are more likely to issue press releases publicising the findings of what may be deemed weaker studies than larger, more scientifically significant trials.

Looking at seven of the world’s most prestigious medical journals, researchers found that half of published observational studies were the subject of a press release, compared with just 17 per cent of randomised controlled trials (RCTs), despite the latter being seen as the only way to reliably test a hypothesis.

There was a similar pattern when looking at the most reliable type of research: RCTs with large numbers of participants. These were given a press release just 14 per cent of the time, compared with 38 per cent of those with smaller samples and observational trials.

It even appears that journalists evened up this discrepancy: agencies and newspapers reported on such “strong” and “weak” research equally, despite the journals giving more publicity to the latter.

“RCTs represent a higher level of evidence than observational studies. Consequently, it might be expected that academic commentary and media coverage would occur more frequently for randomised research than observational research,” concluded “Media Coverage, Journal Press Releases and Editorials Associated with Randomized and Observational Studies in High-Impact Medical Journals: A Cohort Study”.

“However, journal press releases, which influence the content of subsequent news stories, were more common for observational studies than RCTs,” the study, published in the journal Plos One, reported.

Mark Bolland, a co-author and associate professor at the University of Auckland’s School of Medicine, said that he thought the most likely explanation was that because observational studies were not controlled in the same way as RCTs, they were more likely to have positive, quirky or exciting findings, and therefore journals thought that they would receive more coverage.

Previous research by the same authors has warned that press releases were failing to warn journalists of the limitations of observational trials, he said.

“So if you have positive results from an observational study (in which numerous hypotheses might have been examined), and the limitations are not being presented, it is easy to see how that can be turned into a press release that the journal think people will find interesting,” Professor Bolland said.

Journals should focus their press releases on research that can actually inform clinical practice, he said, which normally meant large RCTs.

“Second, if they do a press release on an observational study, they should state the limitations prominently – generally that causality can’t be inferred, that findings from observational research often are not reproduced in clinical trials,” he suggested.

A spokeswoman for the British Medical Journal, one of the journals analysed, said that senior editors selected research to press release “purely on the basis of its news potential, not by study design”.

“We are careful to avoid making inappropriate statements about cause and effect. And, whenever possible, we present absolute risks rather than relative risks,” she added.

david.matthews@tesglobal.com

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Related articles

Related universities

POSTSCRIPT:

Print headline: Journals give more publicity to ‘weak science’, say researchers

Have your say

Log in or register to post comments

Featured Jobs

Most Commented

Monster behind man at desk

Despite all that’s been done to improve doctoral study, horror stories keep coming. Here three students relate PhD nightmares while two academics advise on how to ensure a successful supervision

Sir Christopher Snowden, former Universities UK president, attacks ratings in wake of Southampton’s bronze award

opinion illustration

Eliminating cheating services, even if it were possible, would do nothing to address students’ and universities’ lack of interest in learning, says Stuart Macdonald

Female professor

New data show proportion of professors who are women has declined at some institutions

Reflection of man in cracked mirror

To defend the values of reason from political attack we need to be more discriminating about the claims made in its name, says John Hendry