How the 'small world' effect skews results

January 18, 2002

The research assessment exercise is biased owing to the "small world" effect, according to an analysis by Andrew Colman, an expert in game theory and cooperative reasoning at the University of Leicester.

Professor Colman noticed that the results in small units of assessment were far higher than those in larger units. He analysed the relationship between performance and size and found a "quite large and significant" correlation that allowed him "to rule out chance as the explanation". A quarter of the variance in research ratings is explained by size.

Arguments that smaller units of assessment are genuinely superior at research can also be dismissed, he said. Larger units should be able to select the best researchers from a bigger pool and to train more postgraduates.

Professor Colman said: "In small mutually interdependent communities, people seem more likely to engage in mutually beneficial social behaviour."

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Most Commented

James Fryer illustration (27 July 2017)

It is not Luddism to be cautious about destroying an academic publishing industry that has served us well, says Marilyn Deegan

Jeffrey Beall, associate professor and librarian at the University of Colorado Denver

Creator of controversial predatory journals blacklist says some peers are failing to warn of dangers of disreputable publishers

Hand squeezing stress ball
Working 55 hours per week, the loss of research periods, slashed pensions, increased bureaucracy, tiny budgets and declining standards have finally forced Michael Edwards out
Kayaker and jet skiiers

Nazima Kadir’s social circle reveals a range of alternative careers for would-be scholars, and often with better rewards than academia

hole in ground

‘Drastic action’ required to fix multibillion-pound shortfall in Universities Superannuation Scheme, expert warns