The right answer for MCQs

March 26, 2015

Contrary to the view expressed by Hugh Fletcher, the practice of penalising wrong answers in multiple-choice tests is normatively inferior to simply counting the number of right answers (“Exams with merit”, Letters, 12 March).

For questions with k options, the punishment formula is -1/(k-1), such that random guesses on all questions lead to an expected score of zero. The purpose of such formula scoring is to deter guessing, but even with this formula there is nothing to lose overall from guessing and everything to gain (especially if your guesses are educated ones, which Fletcher alludes to). Therefore, test-takers should guess when they are uncertain, even though the whole point of the formula is to deter guessing. This means that a relative advantage is conferred upon those individuals with a greater appetite for risk. However, tests are meant to measure knowledge, not the risk attitudes of the test-takers, so formula scoring increases unwanted noise in measurement.

Another issue with multiple-choice questions is the location of the correct answer. There is a tendency to place the correct answer in the middle positions, which can be exploited by test-takers. Some setters guard against this by placing the correct answer equally often in each possible position. But people are poor intuitive randomisers and this can also be exploited. The best method is to properly randomise the answer options, which doesn’t necessarily mean the correct answer appearing equally often in each location.

David Hardman
School of Psychology
London Metropolitan University

Times Higher Education free 30-day trial

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Most Commented

Worried man wiping forehead
Two academics explain how to beat some of the typical anxieties associated with a doctoral degree

Felipe Fernández-Armesto takes issue with a claim that the EU has been playing the sovereignty card in Brexit negotiations

Kenny Dalglish

Agnes Bäker and Amanda Goodall have found that academics who are happiest at work have a head of department who is a distinguished researcher. How can such people be encouraged into management?

A group of flamingos and a Marabou stork

A right-wing philosopher in Texas tells John Gill how a minority of students can shut down debates and intimidate lecturers – and why he backs Trump

A face made of numbers looks over a university campus

From personalising tuition to performance management, the use of data is increasingly driving how institutions operate