Quality evaluations

April 16, 2015

How much do student evaluations of the quality of academic staff in universities reflect the quality of academic research? The data from the Times Higher Education Student Experience Survey 2015 published in THE last week show that staff quality evaluations are a fairly good measure of research quality.

If we correlate the grade point average scores from the research excellence framework with the quality of staff measure in the student survey, there is a moderately strong relationship (+0.46) for 91 higher education institutions in England. This means that good researchers tend to do well as teachers, as the REF and the students are by and large in agreement with each other. However, as is well known, the GPA figures were doctored by excluding significant numbers of staff from the exercise. This prompted THE to produce intensity-adjusted GPA scores to compensate.

If we correlate the intensity-weighted GPA with evaluations of the quality of staff in the student survey, the relationship is much stronger (+0.59). This means that there are some really good teachers who are not necessarily strong researchers, and they contribute to the overall quality of the staff. It should be no surprise that the students are evaluating all the staff, not just the ones included in the REF.

But how does this all translate into changes in institutional funding made by the Higher Education Funding Council for England? The correlation between funding changes between 2014 and 2015 and the quality of staff measure in the student survey is zero (-0.03), and the same is true for funding changes and overall student satisfaction ratings (-0.01), indicating that whatever Hefce is incentivising, it is not the quality of staff in universities.

Paul Whiteley
Professor of government
University of Essex

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Most Commented

United Nations peace keeper

Understanding the unwritten rules of graduate study is vital if you want to get the most from your PhD supervision, say Kevin O'Gorman and Robert MacIntosh

David Parkins Christmas illustration (22 December 2016)

A Dickensian tale, set in today’s university

Eleanor Shakespeare illustration (5 January 2017)

Fixing problems in the academic job market by reducing the number of PhDs would homogenise the sector, argues Tom Cutterham

poi, circus

Kate Riegle van West had to battle to bring her circus life and her academic life together

Houses of Parliament, Westminster, government

There really is no need for the Higher Education and Research Bill, says Anne Sheppard