Perverse values and investments in REF

March 6, 2014

Claims about the cost burden imposed by “onerous” methodology for the research excellence framework (“The REF: how was it for you?”,  February) ignore the behavioural response of academics and administrators. An assessment of the UK’s research base has been taken over by a university marketing exercise. “Good enough” has no meaning if the criterion is excellence, and there is nothing that the Higher Education Funding Council for England or any other body might do to regulate the effort invested.

Barbara Pittam, of the Institute of Cancer Research, is quoted as saying that input to a funding formula does not by itself justify the assessment workload. She rightly points out that the outcome also sends signals to the Treasury. In fact, the signals go far wider: to future students and staff, to research funders and to potential partner institutions. The outcomes of the research assessment exercise and the REF are the single most powerful piece of marketing information most institutions can present to the public.

The low-cost alternatives are unacceptable. Pro rata funding for every academic has not made sense for 30 years, and there is no case for any reductionist approach to cheap and simplistic metrics.

Complaints about the REF burden are transitory compared with the complaints that any alternative would embed. If assessment is to mean anything, it needs proper input and review to deliver proper outcomes. Institutions cannot and should not be limited as to the effort they invest, so that they submit the very best possible case. The downside is that, whatever Hefce does, institutions and individual academics will invest “disproportionately” because the outcome matters too much.

Jonathan Adams
Chief scientist, Digital Science


Nicholas Maxwell is right to suggest that the impact agenda is not necessarily helpful in trying to use research outcomes positively in society (“Revolutionary thought”, Opinion, 23 January).

The REF does not encourage a judgement to be made on whether the impact that panels are being asked to assess is good or bad for society; impact is assessed only on its “reach and significance”. Impact itself is defined in the REF as “an effect on, change or benefit to…”. In other words, a benefit is only one option; any effect or change is equally acceptable. So as it stands, research that has led to far-reaching, significant and disastrous impacts on the environment, for example, should score much more highly than research that has led to a small, incremental benefit.

To assess impact in a value-free vacuum, or even to allow value judgements to be made implicitly, is truly “unwise”. If we are establishing a funding system that rewards impact, there should be some explicit consideration of what impacts we believe either have been and would be beneficial to society.

Richard Bond
Head of research administration
University of the West of England

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Most Commented

United Nations peace keeper

Understanding the unwritten rules of graduate study is vital if you want to get the most from your PhD supervision, say Kevin O'Gorman and Robert MacIntosh

David Parkins Christmas illustration (22 December 2016)

A Dickensian tale, set in today’s university

Eleanor Shakespeare illustration (5 January 2017)

Fixing problems in the academic job market by reducing the number of PhDs would homogenise the sector, argues Tom Cutterham

Houses of Parliament, Westminster, government

There really is no need for the Higher Education and Research Bill, says Anne Sheppard

poi, circus

Kate Riegle van West had to battle to bring her circus life and her academic life together