REF health research ‘had little impact on patients’

Paper claims that medical impact case studies focused on policy impact, not improvement in patient mortality or quality of life

October 2, 2015

Last year’s huge assessment of academic quality in the UK that sought to rate the benefits of research may have captured only short-term benefits that had little impact on patients, a new paper has argued.

The research excellence framework controversially asked for case studies in order to judge academia’s impact on the wider world.  

In medicine, the panel that looked at research impact was “extremely impressed” with the results, according to “Research impact in the community-based health sciences: an analysis of 162 case studies from the 2014 UK Research Excellence Framework”.

But the analysis into case studies submitted to the public health, health services and primary care subpanel concludes that universities generally touted changes to guidelines and policies in their case studies, rather than an impact on patients. Only a few case studies actually showed that research had changed patient mortality, morbidity or quality of life.

“There was a striking mismatch between institutions’ claims to have engaged with ‘patients and the public’ (universally made in impact templates) and the limited range and depth of activities oriented to achieving this described in the individual case studies,” it says.

Underlying this problem, the paper argues, is the mistaken idea that medical research can easily have a direct, beneficial impact.

“Policymakers may assume that they can commission targeted research to solve policy problems. In reality, these ‘knowledge-driven’ and ‘problem-solving’ mechanisms of impact are uncommon,” it says. “Clinicians rarely read published research or consciously follow guidelines; and policymakers ask different questions and operate to very different logics, timescales and value systems from researchers.”

The paper argues that it is far more common for research to have an impact indirectly, for example by increasing “tacit knowledge”, or allowing clinicians and policymakers to better understand each other’s work.

This in part might have been due to the design of the assessment itself, the paper notes. “The format of the REF impact case study (strong emphasis on measurable impacts that could be tracked back to the study reported in the ‘research’ section) allowed direct but not indirect flows of influence to be demonstrated,” it says.

The high impact scores given to the impact of medical research in the REF are therefore “no cause for complacency”, the paper warns.

The authors are Trisha Greenhalgh, professor of primary care health sciences at the University of Oxford, and Nick Fahy, a health policy consultant.

david.matthews@tesglobal.com

Read an opinion piece from Trisha Greenhalgh on the issue here

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Related articles

Related universities

Have your say

Log in or register to post comments

Most Commented

question marks PhD study

Selecting the right doctorate is crucial for success. Robert MacIntosh and Kevin O'Gorman share top 10 tips on how to pick a PhD

India, UK, flag

Sir Keith Burnett reflects on what he learned about international students while in India with the UK prime minister

Pencil lying on open diary

Requesting a log of daily activity means that trust between the institution and the scholar has broken down, says Toby Miller

Application for graduate job
Universities producing the most employable graduates have been ranked by companies around the world in the Global University Employability Ranking 2016
Construction workers erecting barriers

Directly linking non-EU recruitment to award levels in teaching assessment has also been under consideration, sources suggest