Everyone’s a critic

June 11, 2015

Trisha Greenhalgh disagrees with my opinion that pre-publication peer review is a waste of time (“Peer review not yet sunk”, Letters, 4 June). Her disagreement, however, is based on a small technical point on one paper that I mentioned in support of one of the many arguments I advanced. Even if she were right in her one point, it would hardly amount to a refutation of my arguments.

She quotes one of the studies we at the BMJ did that showed that peer reviewers are poor at detecting errors in papers. She says that she was a reviewer in one of the studies and saw so many errors in the paper that she described only three. She says, without any evidence, that she is “sure many reviewers would have done what I did”. As far as I can remember, she’s wrong; and she may be unaware that we did similar studies more than once.

She also says that “the BMJ’s staff – then, as now – viewed peer review as a technical task (‘spotting errors’) rather than a scholarly one (interpretation and judgement)”. I can’t answer for now, but I doubt that that is the case, and certainly it wasn’t when I was the editor. Most of the discussion when peer reviewing the papers was around interpretation, and indeed some of the “errors” that we inserted in the papers were to do with interpretation.

It remains true that most reviewers don’t spot most errors, some of them egregious.

I accept that there are problems in studying peer review, but the case stands that we have substantial evidence of the downside of peer review and virtually none of the upside.

Perhaps Greenhalgh might be able to design some better studies to investigate the value or otherwise of peer review.

Richard Smith
Via timeshighereducation.co.uk

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Post-doctoral Research Associate in Chemistry

University Of Western Australia

PACE Data Support Officer

Macquarie University - Sydney Australia

Associate Lecturer in Nursing

Central Queensland University
See all jobs

Most Commented

women leapfrog. Vintage

Robert MacIntosh and Kevin O’Gorman offer advice on climbing the career ladder

Canal houses, Amsterdam, Netherlands

All three of England’s for-profit universities owned in Netherlands

Mitch Blunt illustration (23 March 2017)

Without more conservative perspectives in the academy, lawmakers will increasingly ignore and potentially defund social science, says Musa al-Gharbi

Alexander Wedderburn

Former president of the British Psychological Society remembered

Michael Parkin illustration (9 March 2017)

Cramming study into the shortest possible time will impoverish the student experience and drive an even greater wedge between research-enabled permanent staff and the growing underclass of flexible teaching staff, says Tom Cutterham