What beast is this?

November 26, 2015

Your anonymous correspondent’s account of reviewing for the research excellence framework substantially reflects my own experience as a panellist in 2008 who was offered the chance to be renominated in 2014 (“Why I had to quit the research excellence framework panel”, Opinion, 19 November).

However, it also raises the question of what the exact nature of the task is. Panellists are not asked to read papers as if they were journal reviewers who would be expected to provide detailed and constructive feedback. It is also different from the kind of work that I do as a consultant on submissions, if I am asked to advise specifically on how unit members can improve their ratings. The REF task is much more like exam marking, against three criteria on a five-point scale, with a few notes to justify the decision if there is a disagreement with another reader. While accuracy in individual cases is desirable, what matters is the result for the unit. Most units offer enough decision points to be confident that errors will cancel out. Under these conditions, 20 minutes per paper actually seems excessive, once the panel has established its collective benchmarks.

Robert Dingwall
Dingwall Enterprises
Nottingham


Send to

Letters should be sent to: THE.Letters@tesglobal.com

Letters for publication in Times Higher Education should arrive by 9am Monday. View terms and conditions.

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Analyst

Greenwich School Of Management Ltd

PhD Research Fellow in Medical Physics

Norwegian University Of Science & Technology -ntnu

Senior Knowledge Officer

European Association For International Education

Postdoctoral position in Atmospheric and Space Physics

Norwegian University Of Science & Technology -ntnu
See all jobs

Most Commented

Doctoral study can seem like a 24-7 endeavour, but don't ignore these other opportunities, advise Robert MacIntosh and Kevin O'Gorman

Matthew Brazier illustration (9 February 2017)

How do you defeat Nazis and liars? Focus on the people in earshot, says eminent Holocaust scholar Deborah Lipstadt

Improvement, performance, rankings, success

Phil Baty sets out why the World University Rankings are here to stay – and why that's a good thing

Warwick vice-chancellor Stuart Croft on why his university reluctantly joined the ‘flawed’ teaching excellence framework

people dressed in game of thrones costume

Old Germanic languages are back in vogue, but what value are they to a modern-day graduate? Alice Durrans writes