REF 2014 impact case studies: government policy cited most

Informing government policy was the most common kind of impact submitted to the 2014 research excellence framework, a study has found

March 26, 2015

Source: Alamy

Need to know: informing government policy was most frequent in the sciences

The analysis of the 6,679 unredacted impact case studies submitted was conducted by a team from King’s College London and Digital Science, a scientific technology firm. It was set to be presented at the Higher Education Funding Council for England’s REFlections conference on 25 March.

Text mining revealed that the most common kinds of impact related to “informing government policy”, “parliamentary scrutiny”, “technology commercialisation” and “print, media and publishing”.

Parliamentary scrutiny is more frequent in the social sciences, while informing government policy is more prominent in the sciences. Impact on the media is most common in the humanities.

The prominence of media could be seen as surprising given that the REF rules made clear that media mentions did not in themselves count as impact.

Jonathan Grant, director of the Policy Institute at King’s College London and leader of the analysis, said that he planned to examine further whether panels had given credit for media mentions despite the rules.

Another area where rules may have been bent relates to impacts within the academy – such as the writing of textbooks – which were officially banned. Despite this, the analysis identifies students as the second most frequent beneficiaries – after companies and ahead of children. But Professor Grant “worried” about the accuracy of that analysis given the difficulty of identifying beneficiaries using text mining.

He was more confident about broader conclusions, such as that the research underpinning impact was typically multidisciplinary (in 80 per cent of cases), and that impact was multifaceted (with 60 separate “impact topics” being identified).

Impact was also widespread. The analysis found every country in the world being mentioned in case studies; the US, Australia, Canada, Germany and France were the most cited non-UK beneficiaries.

Although the research underpinning impact could date back to 1993, the majority had been published since 2008. Professor Grant suspected that this was because universities had been more confident about the quality of recent underlying research – which was required to be rated at least 2*.

Such risk aversion had also been apparent, he said, in a RAND Europe analysis of universities’ experiences of preparing impact submissions, also published on 25 March. But he added that there was no consensus among the universities on how to improve the process.

paul.jump@tesglobal.com

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Most Commented

question marks PhD study

Selecting the right doctorate is crucial for success. Robert MacIntosh and Kevin O'Gorman share top 10 tips on how to pick a PhD

India, UK, flag

Sir Keith Burnett reflects on what he learned about international students while in India with the UK prime minister

Pencil lying on open diary

Requesting a log of daily activity means that trust between the institution and the scholar has broken down, says Toby Miller

Microlight pilot flies with flock of cranes

Reports of UK-based researchers already thinking of moving overseas after Brexit vote

Portrait montage of Donald Trump and Nigel Farage

From Donald Trump to Brexit, John Morgan considers the challenges of a new international political climate