REF 2014 impact case studies: government policy cited most

Informing government policy was the most common kind of impact submitted to the 2014 research excellence framework, a study has found

March 26, 2015

Source: Alamy

Need to know: informing government policy was most frequent in the sciences

The analysis of the 6,679 unredacted impact case studies submitted was conducted by a team from King’s College London and Digital Science, a scientific technology firm. It was set to be presented at the Higher Education Funding Council for England’s REFlections conference on 25 March.

Text mining revealed that the most common kinds of impact related to “informing government policy”, “parliamentary scrutiny”, “technology commercialisation” and “print, media and publishing”.

Parliamentary scrutiny is more frequent in the social sciences, while informing government policy is more prominent in the sciences. Impact on the media is most common in the humanities.

The prominence of media could be seen as surprising given that the REF rules made clear that media mentions did not in themselves count as impact.

Jonathan Grant, director of the Policy Institute at King’s College London and leader of the analysis, said that he planned to examine further whether panels had given credit for media mentions despite the rules.

Another area where rules may have been bent relates to impacts within the academy – such as the writing of textbooks – which were officially banned. Despite this, the analysis identifies students as the second most frequent beneficiaries – after companies and ahead of children. But Professor Grant “worried” about the accuracy of that analysis given the difficulty of identifying beneficiaries using text mining.

He was more confident about broader conclusions, such as that the research underpinning impact was typically multidisciplinary (in 80 per cent of cases), and that impact was multifaceted (with 60 separate “impact topics” being identified).

Impact was also widespread. The analysis found every country in the world being mentioned in case studies; the US, Australia, Canada, Germany and France were the most cited non-UK beneficiaries.

Although the research underpinning impact could date back to 1993, the majority had been published since 2008. Professor Grant suspected that this was because universities had been more confident about the quality of recent underlying research – which was required to be rated at least 2*.

Such risk aversion had also been apparent, he said, in a RAND Europe analysis of universities’ experiences of preparing impact submissions, also published on 25 March. But he added that there was no consensus among the universities on how to improve the process.

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Featured Jobs

PhD Scholar in Medicine

University Of Queensland

Manager, Research Systems and Performance

Auckland University Of Technology

Lecturer in Aboriginal Allied Health

University Of South Australia

Lecturer, School of Nursing & Midwifery

Western Sydney University

College General Manager, SHE

La Trobe University
See all jobs

Most Viewed

Most Commented

Lady Margaret Hall, Oxford will host a homeopathy conference next month

Charity says Lady Margaret Hall, Oxford is ‘naive’ to hire out its premises for event

women leapfrog. Vintage

Robert MacIntosh and Kevin O’Gorman offer advice on climbing the career ladder

Woman pulling blind down over an eye
Liz Morrish reflects on why she chose to tackle the failings of the neoliberal academy from the outside
White cliffs of Dover

From Australia to Singapore, David Matthews and John Elmes weigh the pros and cons of likely destinations

Mitch Blunt illustration (23 March 2017)

Without more conservative perspectives in the academy, lawmakers will increasingly ignore and potentially defund social science, says Musa al-Gharbi