Raw data dangers (1 of 2)

May 19, 2011

I read with interest the recent article by Darrel Ince, "Systems failure" (5 May). Unfortunately, I do not think such problems as those he discusses are uncommon with new analyses, but it is rare that they have such an impact.

Ince suggests several lessons to be learned from the Duke University case. However, I foresee one problem of which I have had direct experience.

Having been asked to do a simple conversion of raw data to usable numbers, I was passed the equations to use. Upon checking them, I noticed a mistake. After tracing back the error to the source, it turned out to be a genuine accident, but the conversion had already been used on data that appeared in peer-reviewed publications in some of the top journals and had clearly affected the conclusions. It passed because only the converted values had been presented.

Journals will never be able to go through all the raw data, so unless the data conversion is itself the subject of the paper, such mistakes are unlikely to be discovered.

Ince's suggestions concern each part of the research and publication process. Perhaps this shows that the system works, but only if each component functions correctly.

Name and address withheld

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Most Commented

James Fryer illustration (27 July 2017)

It is not Luddism to be cautious about destroying an academic publishing industry that has served us well, says Marilyn Deegan

Jeffrey Beall, associate professor and librarian at the University of Colorado Denver

Creator of controversial predatory journals blacklist says some peers are failing to warn of dangers of disreputable publishers

Hand squeezing stress ball
Working 55 hours per week, the loss of research periods, slashed pensions, increased bureaucracy, tiny budgets and declining standards have finally forced Michael Edwards out
Kayaker and jet skiiers

Nazima Kadir’s social circle reveals a range of alternative careers for would-be scholars, and often with better rewards than academia

hole in ground

‘Drastic action’ required to fix multibillion-pound shortfall in Universities Superannuation Scheme, expert warns