Measured response

June 29, 2007

Yes, there may be problems with the indicators suggested by the Performance Indicators Review Group ("Performance indicators reprieved", June 22). Measures of research activity, widening participation, retention, student employment and so on are limited in value. Their publication and misuse may lead to unintended responses by universities.

But they are the best figures available; thus their use in isolation and with appropriate caveats is perfectly sensible. The big problem lies in how others treat these numbers. The practice of creating league tables by aggregating these very different measures using arbitrary weightings is pseudo-quantification of the worst kind. How can one find an aggregate of A-level points and the staff-to-student ratio, for example? Mixing input figures (such as student entry qualifications) with process figures (such as spending) and outcome figures (such as subsequent employment) is illogical. Trying to create a value-added model with unmoderated acceptances and degree awards is futile. Using statistical techniques on these population figures, such as confidence intervals designed to illustrate sampling variation only, shows a frightening lack of understanding. Of course, the results are largely predictable because, in the end, the tables are dominated by unmeasured factors such as age of institution, benefactions and, ultimately, geography.

Stephen Gorard
York University

Please login or register to read this article

Register to continue

Get a month's unlimited access to THE content online. Just register and complete your career summary.

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments