The hybrid exam that can turn misfiring students into human cannonballs

Setting pre-seen exams can bring out previously unsuspected abilities among students, say Nicholas Morton and Natasha Hodgson

March 23, 2017
Cannons on a ship

In the 18th century, the Royal Navy decided to experiment with a new type of gun. The plan was to combine the short-range, ship-smashing carronade with the more common and longer-range long cannon to create a new weapon called a cannonade. But the result was a failure. The cannonade possessed neither the power of the carronade nor the range of a cannon, and it was swiftly decommissioned.

We initially suspected that seen exams – exams that students are shown several weeks in advance – might be the cannonade of student evaluation: an unhappy hybrid of the assessed essay and the standard exam, testing neither depth of knowledge and analysis nor ability to marshal and express a well-supported argument from memory. There was also the danger that students would view it as a soft option.

However, despite our misgivings, we decided to give it a try. The plan was to create a short exam paper consisting of a small number of questions that embraced the course as a whole, rather than its individual constituent topics. This, we hoped, would encourage the students out of their comfort zone by testing their overall knowledge, rather than allowing them to rely solely on the content of a couple of seminars.

The first thing that we needed to do was to set some ground rules about how we should rework the examination assessment criteria. Marking needed to be tougher. Fewer allowances would be made for common mistakes, such as misremembered names, dates and the odd howler (“many people in the Middle Ages died of plaque”). Similarly, while all essays need to provide a lucid argument, the seen exam offers the same opportunity to plan, structure and hone a line of reasoning as a coursework essay does – so, we reasoned, it should be similarly refined.

We worried about collusion, so we emphasised the value of originality. We anticipated that some students would prepare too much material, so we encouraged them to practise their answers to time. But the worst-case scenario, we surmised, was the opposite one: that students might not prepare adequately because knowing the questions in advance had instilled false confidence.

Yet, as the exam scripts landed on our desks with a heavy thud (always a happy moment!), it rapidly became clear that the experiment had been a success – for several unforeseen reasons. First – astonishingly – the exam scripts were overwhelmingly better written than conventional essays. While marking standard essays routinely obliges us to ask students to explain their ideas with greater clarity, we rarely had to do so with the seen exam. We concluded that the pressure of a timed environment had caused the students to write-as-they-thought, in a flow of consciousness that was extremely beneficial to their arguments. There were very few examples of the convoluted 10-line sentences and stilted quasi-academic-speak that litter conventional undergraduate coursework. This is great news! Many students lack confidence in their ability to write well, yet our seen exam demonstrated that they can do it.

Another virtue lay in the depth of evidence the students presented. Seemingly, the knowledge that they would ultimately be put on the spot in a bleak exam hall led them to conduct their research very thoroughly, obviating the need for us to ask – as we frequently do when marking conventional exams or essays – to supply more detail, context or case studies.

Our concerns about collusion also proved unfounded. While some students made reference to the same evidence, the exam format meant that they were forced to evaluate and reproduce it in different ways – and, crucially, in their own words. The opportunities for plagiarism were therefore greatly reduced in comparison with those offered by coursework, and, overall, the seen exam encouraged originality.

The benefits we discovered were so significant that we are considering using seen exams again, in preference to a conventional exam. And it is worth underlining that many of those benefits were not predicted in advance. This emphasises the importance of trying new things even when you are sceptical about their efficacy.

In other words, however useless the cannonade turned out to be, those 18th-century naval engineers should have been given 10 out of 10 for effort.

Nicholas Morton and Natasha Hodgson are lecturers in history, languages and international studies at Nottingham Trent University.

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

POSTSCRIPT:

Print headline: Unseen benefits

Have your say

Log in or register to post comments

Featured Jobs

Assistant Recruitment - Human Resources Office

University Of Nottingham Ningbo China

Outreach Officer

Gsm London

Professorship in Geomatics

Norwegian University Of Science & Technology -ntnu

Professor of European History

Newcastle University

Head of Department

University Of Chichester
See all jobs

Most Commented

men in office with feet on desk. Vintage

Three-quarters of respondents are dissatisfied with the people running their institutions

Mitch Blunt illustration (23 March 2017)

Without more conservative perspectives in the academy, lawmakers will increasingly ignore and potentially defund social science, says Musa al-Gharbi

students use laptops

Researchers say students who use computers score half a grade lower than those who write notes

Canal houses, Amsterdam, Netherlands

All three of England’s for-profit universities owned in Netherlands

sitting by statue

Institutions told they have a ‘culture of excluding postgraduates’ in wake of damning study