‘Overflow’ of new research ‘erodes trust between scientists’

Peer review system ‘lacks capacity’ to deal with ‘flood’ of new papers, meaning some could be unjustly dismissed

September 24, 2015
Stack of books

The “deluge” of new scientific papers that academics have to read makes it all but impossible to know what research to trust, according to a new paper based on candid interviews with biomedical researchers.

This “overflow” of new information, which the current system of peer review does not have the capacity to filter and check, risks good research being ignored and experiments duplicated because scientists are unaware of all the work being done in their area.

In recent years prominent scandals over research fraud and irreproducible results have shaken trust in science. To explore these concerns, scholars interviewed 20 experienced biomedical principal investigators in the US.

Actual scientific fraud was not seen as a major issue, because although very serious, it was also extremely rare, according to “Overflow in science and its implications for trust”, published in the journal eLife.

Instead the authors raised concerns about “the rapid proliferation of journals, and the immense number of papers being published in relatively new mega-journals”.

“There’s a flood, there’s a deluge of published and unpublished papers,” said co-author Sabina Siebert, a senior lecturer in management at the University of Glasgow. Scholars who previously did not publish were now under pressure to do so, while emerging economies were also contributing, she added.

One researcher, interviewed anonymously, pointed out that the sheer size of papers had also ballooned. “I tell people in my lab, go and…pick up a copy of Cell from the 1970s or Journal of Cell Biology…papers that were published then, would be Figure 1A of a Cell paper today,” they said.

Too much information – known as “overflow” in social science – forces scientists to rely on colleagues’ reputations or journal prestige to judge a paper’s importance or trustworthiness, the paper argues. “If I don’t know the authors then I will have to look more carefully at the data,” said one interviewee.

This can lead to an “unjustified lack of trust” in relatively unknown authors, the paper argues. There was “absolutely” a possibility that this “overflow” could increase the risk that research is done twice, or heavily overlaps, because scientists are unaware research has been done before, Dr Siebert said.

Yet at the same time, the mass of new research has led to intense competition to be published in high-profile journals, she added, leading to the risk of corners being cut, thereby further reducing trust among scientists.

One interviewee said: “For me the bigger concern is…trying to make it a hot, sexy story to try to get into a high tier journal. For me that’s a bigger problem because it creates pressure on junior people…to feel that they will only get a job if they publish in Nature or Science or Cell, and if they don’t publish there they’re washed-up, useless, a failure.”

Dr Siebert said that while the current system of peer review “broadly” works, “it has only so much capacity”. Instead, peer review could be supplemented by an initial stage of checking experimental design, statistics, analysis and images before a paper is sent to an academic reviewer, the study suggests.

david.matthews@tesglobal.com

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Assistant Recruitment - Human Resources Office

University Of Nottingham Ningbo China

Outreach Officer

Gsm London

Professorship in Geomatics

Norwegian University Of Science & Technology -ntnu

Professor of European History

Newcastle University

Head of Department

University Of Chichester
See all jobs

Most Commented

men in office with feet on desk. Vintage

Three-quarters of respondents are dissatisfied with the people running their institutions

A face made of numbers looks over a university campus

From personalising tuition to performance management, the use of data is increasingly driving how institutions operate

students use laptops

Researchers say students who use computers score half a grade lower than those who write notes

Canal houses, Amsterdam, Netherlands

All three of England’s for-profit universities owned in Netherlands

As the country succeeds in attracting even more students from overseas, a mixture of demographics, ‘soft power’ concerns and local politics help explain its policy