The publication game leads to trivial pursuits

Growing pressure to publish only in elite tier ignores the vital importance of lesser-ranked titles to academia and society, says Adam Graycar

August 23, 2018
ladder-star-moon
Source: James Fryer

When I was a student decades ago, at a “good” Australian university, most teachers thought and taught but did little or no research. The mantra soon shifted to “publish or perish”, prompting at least some academics to churn out books and articles by the dozen. Now, though, volume is not enough: you have to go straight to the top.

I work in two very distinct universities: one is among the Asian and global elite, the other is a modest institution that has aspirations of doing better. But academics at both are told by their leaders that it is better not to publish at all than to publish in anything less than a top-ranked journal.

In both cases, this approach is utterly wrong-headed – especially in social science.

Research in physics, medicine or biology has global resonance (science is universal), but this is not so with the social sciences. A study of differences between voters in western Sydney and those in western New South Wales is not going to get a look-in at the American Political Science Review, no matter how well constructed the study or how rigorous the execution, because it would be considered parochial.

Instead, such journals prize methodological sophistication and very high analytical ability above all else. Method triumphs over content. What this leads to is the dissection of trivia with an ever-sharper knife. I have often seen young academics take some inconsequential data and manipulate them until the pips squeak. After the umpteenth regression, some relationship between two variables may emerge, resulting in a paper whose conclusion notes that more research needs to be done to explore this apparent connection.

When I was dean at a major US university, a job applicant presented a talk on offences, punitiveness and locations. She used dazzling statistical techniques to analyse the data, and my colleagues quizzed her on various measures and statistical tests. At the end, I asked what policy advice might be given to state or local governments based on her research. My colleagues glared at me, and the applicant replied that she did not know. She did not get the job, but the paper was published in a top-tier journal.

The emphasis on writing only for the top journals means that stories about how people live get told less and less often. And when they are told, they are confined either to journals aimed at practitioners or to popular outlets – from both of which there is usually more to learn than from the elite journals, therefore.

Always aiming for the top also goes against the grain of a learning enterprise, in which people do an apprenticeship – a PhD – and progress from level to level. Junior academics should, of course, be encouraged to take on the world; but if anyone should be expected to do so, it should be only senior professors. Juniors will learn from their apprenticeship and make a valuable contribution even if their work is not published in the top journals.

But focusing only on elite journals is very bad for the morale of all thoughtful academics. The process of getting published is tortuous and, despite the use of peer review, not always particularly meritocratic.

The top journals pride themselves on rejecting the overwhelming proportion of articles they receive. Sometimes articles are rejected without being sent out for peer review. This is at least mercifully quick. What normally happens is that the rejection comes many months after submission because of the length of time it takes to find good reviewers. Sometimes it is accompanied by constructive and helpful feedback from the reviewers, but other times by cruel and disparaging comments from unscrupulous rivals. I recently was told about a rising star in a US university who proudly told her colleague that she rejected all the articles that came her way because she did not want her competitors to get ahead. Such people are doubtless the exception rather than the rule, but there is no checking on such behaviour.

In the unlikely event that the manuscript is ultimately accepted, it might be published online within a few weeks, but will wait in a queue for about two years – sometimes more – before being assigned volume and page numbers, alerting more readers to its existence and allowing it to be cited properly.

Our university leaders tell us that such citations are terribly important. But surely readership is the key metric – and, moreover, readership by those beyond our peer groups. In the social sciences, you would hope that articles are read not merely by other academics but also by students and, above all, practitioners. If our work has no relevance to such people, university leaders and academics alike should be asking themselves what all this effort, expense and stress in pursuit of global excellence is really worth.

Adam Graycar is professor of public policy at Flinders University.

Please login or register to read this article

Register to continue

Get a month's unlimited access to THE content online. Just register and complete your career summary.

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

POSTSCRIPT:

Print headline: Mania for elite journals results in global game of trivial pursuits

Reader's comments (6)

So what should we do?
A ranking of journals by practitioners would be a good start as I estimate that it would be a sobering experience for most '4*' editors. As Adam says in his article the sole criteria for publication often seems to be whether a piece of research is well analysed rather than its global importance or relevance. The result is that top journals, at least in management and business, are full of well analysed trivia.
There is a lot of confusion among academics concerning where to publish research results. I am of the view that research design should be aimed at contributing to existing knowledge and published on platform with adequate peer review, plagiarism mechanism and good editorship. Top-ranked journals have very high article rejection rates and thousands of researchers cannot depend solely on them. This is a fact that HE institutions worldwide should appreciate. There are many other publication platforms, apart from top-ranked ones, that publish good quality articles.
IF journalism is simply a giant ponzi scheme
I love the 'dissection of trivia with an ever-sharper knife' - great image. And great sentiments in the article. This is all bad enough and prominent enough in UK, Australia and USA - where at least there is some insight into the problem, even if no will to do anything about it. What about China, Taiwan, Singapore? They seem to have no insight, just a huge drive to hit the top journals and, moreover, only to publish 'original' research - so a well conducted systematic review does not count; they simply plough on, on the whole, without assessing the state of the art. There are some individuals who buck that trend - at personal cost to career advancement. Declaration of interests: I edit the highest cited academic journal in my field (nursing); reject 50% of the articles on submission and publish on 20% overall.
All right and important. I still would like to add one point, subdivided: (i) generally, doesn't result-oriented, mostly empirically-oriented ("evidence-based") research as standard expectation and kind-off methodological ultimate ratio contribute ver much to such competitive orientation even before it comes to considerations concerning publication? I suppose such research is more inclined to competition than "fundamental research" ("Grundlagenforschung"). (ii) isn't already the entire system of (mass)education as PRIMARILY "vocational training like education, driving (future) researchers into the direction of competition-driven instead of knowledge-enhancement driven? - This begins already when looking at the way of dealing with applications by students for courses - see some experience-based views at https://wp.me/p1qrWe-1qC

Have your say

Log in or register to post comments