What beast is this?

November 26, 2015

Your anonymous correspondent’s account of reviewing for the research excellence framework substantially reflects my own experience as a panellist in 2008 who was offered the chance to be renominated in 2014 (“Why I had to quit the research excellence framework panel”, Opinion, 19 November).

However, it also raises the question of what the exact nature of the task is. Panellists are not asked to read papers as if they were journal reviewers who would be expected to provide detailed and constructive feedback. It is also different from the kind of work that I do as a consultant on submissions, if I am asked to advise specifically on how unit members can improve their ratings. The REF task is much more like exam marking, against three criteria on a five-point scale, with a few notes to justify the decision if there is a disagreement with another reader. While accuracy in individual cases is desirable, what matters is the result for the unit. Most units offer enough decision points to be confident that errors will cancel out. Under these conditions, 20 minutes per paper actually seems excessive, once the panel has established its collective benchmarks.

Robert Dingwall
Dingwall Enterprises

Send to

Letters should be sent to: THE.Letters@tesglobal.com

Letters for publication in Times Higher Education should arrive by 9am Monday. View terms and conditions.

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Most Commented

Home secretary says government will support 'best' universities

Man handing microphone to audience member

Academic attainment of disadvantaged students can be improved if they can decide how they are assessed, study claims

Woman drinking tea from saucer

Plugging a multibillion-pound deficit exacerbated by June’s poll result may require ‘drastic measures’, analysts have warned

Italy's gold medallist

New measures to ensure universities are ‘not penalised’ for taking poorer students also outlined for next stage of TEF

Classroom, school

Higher education institutions can and should do more to influence education at a secondary school level, says Edward Peck