Quality evaluations

April 16, 2015

How much do student evaluations of the quality of academic staff in universities reflect the quality of academic research? The data from the Times Higher Education Student Experience Survey 2015 published in THE last week show that staff quality evaluations are a fairly good measure of research quality.

If we correlate the grade point average scores from the research excellence framework with the quality of staff measure in the student survey, there is a moderately strong relationship (+0.46) for 91 higher education institutions in England. This means that good researchers tend to do well as teachers, as the REF and the students are by and large in agreement with each other. However, as is well known, the GPA figures were doctored by excluding significant numbers of staff from the exercise. This prompted THE to produce intensity-adjusted GPA scores to compensate.

If we correlate the intensity-weighted GPA with evaluations of the quality of staff in the student survey, the relationship is much stronger (+0.59). This means that there are some really good teachers who are not necessarily strong researchers, and they contribute to the overall quality of the staff. It should be no surprise that the students are evaluating all the staff, not just the ones included in the REF.

But how does this all translate into changes in institutional funding made by the Higher Education Funding Council for England? The correlation between funding changes between 2014 and 2015 and the quality of staff measure in the student survey is zero (-0.03), and the same is true for funding changes and overall student satisfaction ratings (-0.01), indicating that whatever Hefce is incentivising, it is not the quality of staff in universities.

Paul Whiteley
Professor of government
University of Essex

Times Higher Education free 30-day trial

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Most Commented

Daniel Mitchell illustration (29 June 2017)

Academics who think they can do the work of professional staff better than professional staff themselves are not showing the kind of respect they expect from others

As the pay of BBC on-air talent is revealed, one academic comes clean about his salary

Senior academics at Teesside University put at risk of redundancy as summer break gets under way

Thorns and butterflies

Conditions that undermine the notion of scholarly vocation – relentless work, ubiquitous bureaucracy – can cause academics acute distress and spur them to quit, says Ruth Barcan

University of Oxford

Reinstatement of professor over age discrimination must force rethink over ‘unfair’ retirement rules, say campaigners