Measures to REFer to

May 14, 2015

The suggestion to rank institutions according to quality-related funding per staff member submitted to the research excellence framework is problematic, and not only because some research fields are much more expensive than others (“Can you win by fielding the whole team?”, Research intelligence, 7 May). Such a ranking is also distorted by institutional differences in staff selectivity: REF-excluded staff are awarded zero QR funding but are not counted.

An alternative, which would lead to rankings that are more informative and would also reduce the institutional tension between league table position and QR funding, is to use a “quality per researcher” measure, in which every REF-eligible researcher is counted, and where the “quality” score is similar to grade point average but with the GPA weights of 4, 3, 2, 1 and 0 for REF quality levels replaced by the weights that determine QR funding. This is one of the conclusions reached by a working party set up by the Royal Statistical Society to consider how rankings based on REF results could be improved.

The report of the society’s working party (www.rss.org.uk/ref) also makes some related suggestions for the funding councils themselves about REF submission rules and reporting; these include elimination of the distorting “threshold” effect of the REF’s formula for the number of impact case studies in each submission.

Peter J. Diggle
President
Royal Statistical Society

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Researcher in Fluid Dynamics

Norwegian University Of Science & Technology -ntnu

Analyst

Greenwich School Of Management Ltd

PhD Research Fellow in Medical Physics

Norwegian University Of Science & Technology -ntnu

Postdoctoral position in Atmospheric and Space Physics

Norwegian University Of Science & Technology -ntnu

PhD Fellow in Machine Learning

Norwegian University Of Science & Technology -ntnu
See all jobs

Most Commented

Doctoral study can seem like a 24-7 endeavour, but don't ignore these other opportunities, advise Robert MacIntosh and Kevin O'Gorman

Matthew Brazier illustration (9 February 2017)

How do you defeat Nazis and liars? Focus on the people in earshot, says eminent Holocaust scholar Deborah Lipstadt

Improvement, performance, rankings, success

Phil Baty sets out why the World University Rankings are here to stay – and why that's a good thing

Warwick vice-chancellor Stuart Croft on why his university reluctantly joined the ‘flawed’ teaching excellence framework

people dressed in game of thrones costume

Old Germanic languages are back in vogue, but what value are they to a modern-day graduate? Alice Durrans writes