The right answer for MCQs

March 26, 2015

Contrary to the view expressed by Hugh Fletcher, the practice of penalising wrong answers in multiple-choice tests is normatively inferior to simply counting the number of right answers (“Exams with merit”, Letters, 12 March).

For questions with k options, the punishment formula is -1/(k-1), such that random guesses on all questions lead to an expected score of zero. The purpose of such formula scoring is to deter guessing, but even with this formula there is nothing to lose overall from guessing and everything to gain (especially if your guesses are educated ones, which Fletcher alludes to). Therefore, test-takers should guess when they are uncertain, even though the whole point of the formula is to deter guessing. This means that a relative advantage is conferred upon those individuals with a greater appetite for risk. However, tests are meant to measure knowledge, not the risk attitudes of the test-takers, so formula scoring increases unwanted noise in measurement.

Another issue with multiple-choice questions is the location of the correct answer. There is a tendency to place the correct answer in the middle positions, which can be exploited by test-takers. Some setters guard against this by placing the correct answer equally often in each possible position. But people are poor intuitive randomisers and this can also be exploited. The best method is to properly randomise the answer options, which doesn’t necessarily mean the correct answer appearing equally often in each location.

David Hardman
School of Psychology
London Metropolitan University

Times Higher Education free 30-day trial

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Featured Jobs

Head of Visual Arts UNIVERSITY OF HERTFORDSHIRE
Research Officer - Big Data for Better Outcomes LONDON SCHOOL OF ECONOMICS & POLITICAL SCIENCE LSE
Lecturer in Oral Microbiology UNIVERSITY OF BRISTOL

Most Commented

question marks PhD study

Selecting the right doctorate is crucial for success. Robert MacIntosh and Kevin O'Gorman share top 10 tips on how to pick a PhD

India, UK, flag

Sir Keith Burnett reflects on what he learned about international students while in India with the UK prime minister

Pencil lying on open diary

Requesting a log of daily activity means that trust between the institution and the scholar has broken down, says Toby Miller

Application for graduate job
Universities producing the most employable graduates have been ranked by companies around the world in the Global University Employability Ranking 2016
Construction workers erecting barriers

Directly linking non-EU recruitment to award levels in teaching assessment has also been under consideration, sources suggest