‘Naive’ TEF metrics could undermine widening participation, v-c warns

Simon Gaskell says Queen Mary University of London would be ‘crucified’ on graduate salary score because of diverse intake

November 17, 2015

The use of “naive” and “imprecise” metrics in the teaching excellence framework could thwart the government’s widening participation agenda, a university leader has warned.

Improving access for students from disadvantaged backgrounds is a key part of the higher education Green Paper, but Simon Gaskell, principal of Queen Mary University of London, told MPs that using data on graduate employment as a key measure of institutional performance in the TEF could “perversely work against” this.

Professor Gaskell, chair of the Universities UK quality assessment group, told the House of Commons Business, Innovation and Skills Select Committee that graduates’ success in the job market was shaped by a lot more than teaching quality, with financial and social privilege also playing a key role.

Speaking at the committee’s first evidence session on assessing quality in higher education, Professor Gaskell said that his institution would be “crucified” by a score based on graduate salaries, because a large proportion of its students come from disadvantaged backgrounds.

“Using imperfect metrics, naive and imprecise metrics, could have exactly the opposite effect to what we are all aiming for,” Professor Gaskell said.

Other metrics could create equally perverse incentives, Professor Gaskell argued: having a measure based on the proportion of first-class degrees awarded could lead to grade inflation, while one based on retention would create a temptation to lower standards, he said.

Professor Gaskell also took issue with the claim made by Jo Johnson, the universities minister, that the TEF was needed to deal with “patchy” teaching standards in the sector.

He acknowledged that not all lectures were of a uniformly high standard, but said that the term patchy “implies a level of problem that doesn’t exist”.

“The level of teaching, I believe, generally, is high,” he said.

MPs also heard from Colin Riordan, vice-chancellor of Cardiff University and chair of Universities Wales, who said that, even though there would not be the incentive of tuition fee increases, Welsh universities would probably want to take part in the TEF to illustrate their teaching quality.

Alastair Sim, director of Universities Scotland, told the committee that Scottish higher education institutions were happy with their quality assurance arrangements but may find themselves feeling that they needed to take part in the TEF for “international marketing” reasons.


You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Reader's comments (2)

There is a need to consider who the representatives of universities should be when communicating with the House of Commons... but good that Professor Gaskell has 'learned' from his tenure at Queen Mary. To quote his contribution in 2012 in these same pages entitled "From here to prosperity", written in response to academics who complained about his use of "naive" and "imprecise" metrics used for the evaluation of academics working in the School of Biological and Chemical Sciences: "Our recent restructuring programme has been driven by differing combinations of academic and financial considerations. We appreciate that these changes have been difficult for colleagues. Where academic performance has been assessed, it has been important to do so on the basis of objective criteria including metrics - any subjective assessment would be quite unacceptable. These objective criteria were based on generally recognised academic expectations and set at levels that reflect the imprecision of any such measures."

Have your say

Log in or register to post comments

Featured Jobs

Assistant Recruitment - Human Resources Office

University Of Nottingham Ningbo China

Outreach Officer

Gsm London

Professorship in Geomatics

Norwegian University Of Science & Technology -ntnu

Professor of European History

Newcastle University

Head of Department

University Of Chichester
See all jobs

Most Commented

men in office with feet on desk. Vintage

Three-quarters of respondents are dissatisfied with the people running their institutions

Mitch Blunt illustration (23 March 2017)

Without more conservative perspectives in the academy, lawmakers will increasingly ignore and potentially defund social science, says Musa al-Gharbi

students use laptops

Researchers say students who use computers score half a grade lower than those who write notes

Canal houses, Amsterdam, Netherlands

All three of England’s for-profit universities owned in Netherlands

sitting by statue

Institutions told they have a ‘culture of excluding postgraduates’ in wake of damning study