The right answer for MCQs

March 26, 2015

Contrary to the view expressed by Hugh Fletcher, the practice of penalising wrong answers in multiple-choice tests is normatively inferior to simply counting the number of right answers (“Exams with merit”, Letters, 12 March).

For questions with k options, the punishment formula is -1/(k-1), such that random guesses on all questions lead to an expected score of zero. The purpose of such formula scoring is to deter guessing, but even with this formula there is nothing to lose overall from guessing and everything to gain (especially if your guesses are educated ones, which Fletcher alludes to). Therefore, test-takers should guess when they are uncertain, even though the whole point of the formula is to deter guessing. This means that a relative advantage is conferred upon those individuals with a greater appetite for risk. However, tests are meant to measure knowledge, not the risk attitudes of the test-takers, so formula scoring increases unwanted noise in measurement.

Another issue with multiple-choice questions is the location of the correct answer. There is a tendency to place the correct answer in the middle positions, which can be exploited by test-takers. Some setters guard against this by placing the correct answer equally often in each possible position. But people are poor intuitive randomisers and this can also be exploited. The best method is to properly randomise the answer options, which doesn’t necessarily mean the correct answer appearing equally often in each location.

David Hardman
School of Psychology
London Metropolitan University

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Analyst

Greenwich School Of Management Ltd

PhD Research Fellow in Medical Physics

Norwegian University Of Science & Technology -ntnu

Senior Knowledge Officer

European Association For International Education

Postdoctoral position in Atmospheric and Space Physics

Norwegian University Of Science & Technology -ntnu
See all jobs

Most Commented

Doctoral study can seem like a 24-7 endeavour, but don't ignore these other opportunities, advise Robert MacIntosh and Kevin O'Gorman

Matthew Brazier illustration (9 February 2017)

How do you defeat Nazis and liars? Focus on the people in earshot, says eminent Holocaust scholar Deborah Lipstadt

Improvement, performance, rankings, success

Phil Baty sets out why the World University Rankings are here to stay – and why that's a good thing

Warwick vice-chancellor Stuart Croft on why his university reluctantly joined the ‘flawed’ teaching excellence framework

people dressed in game of thrones costume

Old Germanic languages are back in vogue, but what value are they to a modern-day graduate? Alice Durrans writes