Graduate jobs data deemed flawed

February 7, 2003

Performance indicators designed to measure universities' success in getting graduates into work are worthless, a professor of economics who has studied the formula and pronounced it fundamentally flawed, has said.

The indicators, devised by the Higher Education Funding Council for England, are based on "totally inadequate" data, according to Jim Taylor of Lancaster University's Business School.

"The aim of developing statistical methods to accurately measure the employability of each university's graduates is fine," Professor Taylor said. "But in practice, the published performance indicators have substantial and serious weaknesses. They are completely meaningless."

Graduates from some long-established universities are able to get a job quickly after graduating because of a "halo" effect. High employability may indicate that a university is highly regarded by employers because of its past achievements.

Graduates from newer and less fashionable universities are consequently at a disadvantage.

Another factor ignored by the benchmark is location. "Students in universities where there are plenty of jobs have an obvious advantage over more isolated areas," Professor Taylor said.

However, these shortcomings paled into insignificance when compared with the inadequacy of the data, Professor Taylor said.

The employability rate is calculated from the annual First Destinations Survey conducted six months after graduation.

The methods used to collect the data differ between universities and there is no accuracy check. Therefore a university judged to be performing badly may simply be less skilled at finding graduates who have managed to find employment.

A further criticism is that the first-destination data reveal only how quickly graduates get jobs. Graduates may want to delay making a decision about their long-term career. Moreover, the employability indicator provides no information about the quality of the jobs acquired.

"We really need information over a much longer period of time, such as three years or more after graduation," Professor Taylor said.

"We also need information about the type of job training being received, as well as salary levels, job turnover and job satisfaction."

Hefce said its indicators were designed to provide reliable information on the sector, providing a consistent set of measures.

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Most Commented

James Fryer illustration (27 July 2017)

It is not Luddism to be cautious about destroying an academic publishing industry that has served us well, says Marilyn Deegan

Hand squeezing stress ball
Working 55 hours per week, the loss of research periods, slashed pensions, increased bureaucracy, tiny budgets and declining standards have finally forced Michael Edwards out
Jeffrey Beall, associate professor and librarian at the University of Colorado Denver

Creator of controversial predatory journals blacklist says some peers are failing to warn of dangers of disreputable publishers

Kayaker and jet skiiers

Nazima Kadir’s social circle reveals a range of alternative careers for would-be scholars, and often with better rewards than academia

hole in ground

‘Drastic action’ required to fix multibillion-pound shortfall in Universities Superannuation Scheme, expert warns