Study calls for proper reporting of experiments

Without proper reporting social and psychological experiments are a “waste of money”, researchers have said.

June 2, 2013

A study by academics at the University of Oxford and University College London reviewed more than 200 experiments across 40 leading journals in social and behavioural sciences.

They found that reports did not carry full details about how the interventions in psychology, criminology, education, and social work were implemented.

Without the “missing details”, it was difficult for policymakers and practitioners to put interventions into practice, says the study, published in the journal PLOS ONE on 29 May.

In the era of austerity, policymakers increasingly look for evidence of “what works” to ensure that money is well spent on programmes in areas such as poverty, mental health, crime, and drug use, said Paul Montgomery, professor of psycho-social interventions at Oxford.

“Evaluations of these programmes can be expensive. When they are reported fully and transparently, they can help policymakers choose the most effective way to spend public funds; however, readers rely on reports of these studies in academic journals to effectively understand and use the research.

“Reporting guidelines are a critical step in improving this area of research for policy decision-making,” he added.

Under the banner of the CONSORT or Consolidated Standards of Reporting Trials project, the authors now plan to lead a global effort to develop reporting standards for such experiments, building on existing guidelines used in medicine and other disciplines.

The research team hopes that scientists, journal editors, policymakers and other interested groups will contribute to the discussion.

“There are many excellent experiments that identify ways to improve social and psychological care. Too often, these studies cannot be used because published reports are missing critical details,” added Evan Mayo-Wilson, senior researcher in psychology at UCL.

Missing details flagged in the study included poor reporting of information about blinding in trials, as well as on participant uptake and the actual delivery of experimental and control interventions.

The study also found that only 11 of 40 journals referenced reporting guidelines in their “Instructions to Authors”.

“Social and psychological research should help us change people’s lives. To do that, the scientific record needs to be both accurate and complete,” said Dr Mayo-Wilson.

Through a collective effort, he hoped the problem could be solved in a few years, he added.

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Featured Jobs

Assistant Recruitment - Human Resources Office

University Of Nottingham Ningbo China

Outreach Officer

Gsm London

Professorship in Geomatics

Norwegian University Of Science & Technology -ntnu

Professor of European History

Newcastle University

Head of Department

University Of Chichester
See all jobs

Most Commented

men in office with feet on desk. Vintage

Three-quarters of respondents are dissatisfied with the people running their institutions

Mitch Blunt illustration (23 March 2017)

Without more conservative perspectives in the academy, lawmakers will increasingly ignore and potentially defund social science, says Musa al-Gharbi

students use laptops

Researchers say students who use computers score half a grade lower than those who write notes

Canal houses, Amsterdam, Netherlands

All three of England’s for-profit universities owned in Netherlands

sitting by statue

Institutions told they have a ‘culture of excluding postgraduates’ in wake of damning study