Citation not needed

June 25, 2015

The research excellence framework physics subpanel “used” citations only as a secondary source of information and as a sanity check to “inform” the peer review assessment (“Can metrics really replace reviewers in REF?”, Research Intelligence, 18 June). All physics outputs were read by at least two assessors and peer reviewed accordingly.

My attitude as chair of the physics REF panel to citations was predicated on a study that I did before the REF began of the three main citation providers. In a randomly selected sample of about 20 physics papers submitted to the research assessment exercise, I found discrepancies, often large, between the citation numbers returned by each of the three providers. If the input data from the providers are discrepant, how can we ever use citation-based metrics to predict anything other than the broadest of conclusions? In addition, since citations cannot be used in arts subjects and any REF-like exercise must treat all subject areas on as level a playing field as practicable, this whole discussion seems moot.

I agree that there is a substantial cost to the REF in terms of staff time and effort, but while the government insists on an assessment of research, I cannot think of a viable alternative. I would support returning to the old system of quinquennial grants, but I am not holding my breath for the announcement of this nirvana.

Brian Foster
Via timeshighereducation.co.uk

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Reader in Politics and Policy

St Marys University, Twickenham

Engineer

Cern

Professor of Anthropology

Maynooth University

Preceptor in Statistics

Harvard University

Postdoctoral Fellowship in Electrochemistry

Norwegian University Of Science & Technology -ntnu
See all jobs

Most Commented

Doctoral study can seem like a 24-7 endeavour, but don't ignore these other opportunities, advise Robert MacIntosh and Kevin O'Gorman

Matthew Brazier illustration (9 February 2017)

How do you defeat Nazis and liars? Focus on the people in earshot, says eminent Holocaust scholar Deborah Lipstadt

Improvement, performance, rankings, success

Phil Baty sets out why the World University Rankings are here to stay – and why that's a good thing

Laurel and Hardy sawing a plank of wood

Working with other academics can be tricky so follow some key rules, say Kevin O'Gorman and Robert MacIntosh

Warwick vice-chancellor Stuart Croft on why his university reluctantly joined the ‘flawed’ teaching excellence framework