Open peer review 'better quality' than traditional process

Public scrutiny may force up quality of peer review, suggests study

October 15, 2015
Businessman holding white face mask

Open peer review produces better scrutiny of research than traditional methods, according to a new study.

Reviews were found to be of slightly higher quality – around 5 per cent better – when authors could see who had reviewed their papers and these assessments were made available with the published article.

Researchers compared 400 papers in two similar journals: BMC Infectious Diseases, which uses open peer review, and BMC Microbiology, which uses the common “single-blind” process where reviewers know the identity of the author but the author does not know who they are being reviewed by.

Judged using a scorecard of eight criteria, the open reviews were of moderately better quality than the single-blind reviews, according to the paper published in the journal BMJ Open.

One of the arguments for anonymity during the review process is that reviewers are able to be more frank in their assessments without fear of retribution from colleagues; or, in the “double-blind” process where both are anonymous, reviewers simply look at the content of the paper, rather than being influenced by biases or preconceptions about the author.

But according to one of the new paper’s authors, Maria Kowalczuk, biology editor of the research integrity group at publisher Biomed Central, when reviews were in the open, “reviewers know their reviews are going to be published” and so this might mean quality becomes “slightly better”. The reviews were also more constructive when they were open, the paper found.

Publishing reviews of articles also means the public can “have an insight into the reviewing process”, she added. “We believe that moving towards open peer review is a positive thing”.

Currently, there are “not very many” journals using open peer review, but the number “seems to be increasing”, she said.

However, another aspect of the study looked at the Journal of Inflammation, which switched from open peer review to single-blind in 2010, but found no change in quality.

Another finding was that when authors recommended reviewers to journals, the reviewer was more likely to recommend that it be published than when journals sought out reviewers themselves. This held true whether the process was open or anonymous.

“They might be more sympathetic to the research the author is doing,” explained Dr Kowalczuk.

david.matthews@tesglobal.com

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

POSTSCRIPT:

Print headline: Open peer review better quality than blind route

Have your say

Log in or register to post comments

Featured Jobs

Student Hub Advisor

Greenwich School Of Management Ltd

Data Systems Administrator

Greenwich School Of Management Ltd

Deputy Vice Chancellor

University Of Cumbria

Professor in English Literature

University Of Glasgow
See all jobs

Most Commented

Doctoral study can seem like a 24-7 endeavour, but don't ignore these other opportunities, advise Robert MacIntosh and Kevin O'Gorman

Matthew Brazier illustration (9 February 2017)

How do you defeat Nazis and liars? Focus on the people in earshot, says eminent Holocaust scholar Deborah Lipstadt

Improvement, performance, rankings, success

Phil Baty sets out why the World University Rankings are here to stay – and why that's a good thing

Warwick vice-chancellor Stuart Croft on why his university reluctantly joined the ‘flawed’ teaching excellence framework

people dressed in game of thrones costume

Old Germanic languages are back in vogue, but what value are they to a modern-day graduate? Alice Durrans writes