Everyone’s a critic

June 11, 2015

Trisha Greenhalgh disagrees with my opinion that pre-publication peer review is a waste of time (“Peer review not yet sunk”, Letters, 4 June). Her disagreement, however, is based on a small technical point on one paper that I mentioned in support of one of the many arguments I advanced. Even if she were right in her one point, it would hardly amount to a refutation of my arguments.

She quotes one of the studies we at the BMJ did that showed that peer reviewers are poor at detecting errors in papers. She says that she was a reviewer in one of the studies and saw so many errors in the paper that she described only three. She says, without any evidence, that she is “sure many reviewers would have done what I did”. As far as I can remember, she’s wrong; and she may be unaware that we did similar studies more than once.

She also says that “the BMJ’s staff – then, as now – viewed peer review as a technical task (‘spotting errors’) rather than a scholarly one (interpretation and judgement)”. I can’t answer for now, but I doubt that that is the case, and certainly it wasn’t when I was the editor. Most of the discussion when peer reviewing the papers was around interpretation, and indeed some of the “errors” that we inserted in the papers were to do with interpretation.

It remains true that most reviewers don’t spot most errors, some of them egregious.

I accept that there are problems in studying peer review, but the case stands that we have substantial evidence of the downside of peer review and virtually none of the upside.

Perhaps Greenhalgh might be able to design some better studies to investigate the value or otherwise of peer review.

Richard Smith
Via timeshighereducation.co.uk

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Most Commented

United Nations peace keeper

Understanding the unwritten rules of graduate study is vital if you want to get the most from your PhD supervision, say Kevin O'Gorman and Robert MacIntosh

David Parkins Christmas illustration (22 December 2016)

A Dickensian tale, set in today’s university

Eleanor Shakespeare illustration (5 January 2017)

Fixing problems in the academic job market by reducing the number of PhDs would homogenise the sector, argues Tom Cutterham

Houses of Parliament, Westminster, government

There really is no need for the Higher Education and Research Bill, says Anne Sheppard

poi, circus

Kate Riegle van West had to battle to bring her circus life and her academic life together