Journal impact factors ‘no longer credible’

The measure of scholarly impact is now being manipulated so much that it has ceased to be meaningful, editorial claims

November 5, 2015
Glasses lying on top of a journal
Source: iStock

Trickery by editors to boost their journal impact factor means that the widely used metric “has now lost most of its credibility”, according to Research Policy journal.

With many editors now engaged in “ingenious ways” of boosting their impact factor, “one of the main bastions holding back the growing scourge of research misconduct” has been “breached”, the publication warns in an editorial.

In the past two decades, the reliance on impact factors when deciding which academics are promoted or granted tenure has grown.

One of the most widely used impact factors is calculated by Thomson Reuters by dividing the average number of citations given to articles in a journal by the total number of papers. Normally the figure is calculated for articles published over the previous two years.

“Editors’ JIF-boosting stratagems – Which are appropriate and which not?”, by Ben Martin, a professor of science and technology policy studies at the University of Sussex, lists a number of potentially suspect ways journals manipulate this figure.

For example, editors may try to “coerce” authors into citing papers in their journals in return for inclusion.

Also criticised is a relatively new stratagem, the “online queue”, where journals make a number of papers available online but without having published them. This allows them to push up the number of citations they receive, but as articles are not counted until they are published, these papers do not add to the denominator by which the citations are divided.

Another reason this strategy is effective is because citations accumulate more rapidly in years three and four rather than in the first two years after release.

One “leading” management journal, which the editorial does not name, had an online queue of 160 papers stretching back nearly three years at the time of writing.

Because of these problems, “the JIF would now seem to have little credibility as an indicator of the academic standing of a journal”, the article warns.

Thomson Reuters describes its journal citation reports as a “systematic, objective means to critically evaluate the world’s leading journals, with quantifiable, statistical information based on citation data”. The tool has in the past delisted journals suspected of suspiciously high levels of self-citation. 

david.matthews@tesglobal.com

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Related universities

Have your say

Log in or register to post comments

Most Commented

question marks PhD study

Selecting the right doctorate is crucial for success. Robert MacIntosh and Kevin O'Gorman share top 10 tips on how to pick a PhD

India, UK, flag

Sir Keith Burnett reflects on what he learned about international students while in India with the UK prime minister

Pencil lying on open diary

Requesting a log of daily activity means that trust between the institution and the scholar has broken down, says Toby Miller

Microlight pilot flies with flock of cranes

Reports of UK-based researchers already thinking of moving overseas after Brexit vote

Portrait montage of Donald Trump and Nigel Farage

From Donald Trump to Brexit, John Morgan considers the challenges of a new international political climate