In defence of the National Student Survey

John Cater maligns the misuse of an NSS that can offer genuine insight into university teaching

March 11, 2017
Woman with thumbs up sign

Seldom does a day pass without the National Student Survey getting another kicking. If not by the sector, then the Commons; if not the Commons, then the House of Lords while discussing the Higher Education and Research Bill. 

For certain, the NSS has its flaws, and they are flaws that will be accentuated this year by the ill-judged decision to replace “outcome” questions (personal development) with “process” (engagement) questions, conveniently forgetting the number of lectures many of us missed while we were students. 

And they are flaws further accentuated by the decision to eliminate the one question that focused on that key vehicle for representation and participation: the students’ union. 

But what of the alternative view? Twelve years of time series data. Surveys completed every year by the majority of the eligible population, a quarter of a million students across 130 universities and on virtually every degree programme. Twenty-three questions, five possible answers, 115 data fields and shed-loads of open comments – for the committed reader the most valuable source of all.  

Of course, the administration of the survey may have been abused by some, although the evidence is far less compelling than the innuendo. If this is a problem, it could easily be resolved, in 2017 if not in 2005, by changes in how the survey is administered. 

Far greater abuse takes place at the analysis and reporting stage, with the state, the funding council and much of the media lazily focusing on two possible answers (very/mostly satisfied) to one ill-defined generic question (No 22: overall satisfaction).

Two data fields out of more than a hundred. And only to tell us that the answer to 30 million individual data entries every year is “87” (which is the near-perennial percentage for the number of students who are “very” or “mostly” satisfied, according to Question 22). Reductio ad absurdum. Douglas Adams would have been delighted – and a quarter of a million respondents have the right to feel insulted.  

So we now approach the teaching excellence framework, and the institutionally critical division of universities into gold, silver and bronze, not (regrettably) “outstanding”, “excellent” and “meets expectations”. And we do so with the most fully developed measure we have of students’ perception of their learning experience denigrated and disparaged, with commentators claiming that responses to questions such as whether “feedback on my work has been prompt” are influenced by the attractiveness of the tutor (hopefully another nebulous concept). 

Indeed, the UK higher education minister Jo Johnson, in his letter to the House of Lords on 3 March, specifically supports this downplaying when he states that “we have explicitly said that the NSS metrics are the least important”. 

The counterweights to the NSS are already there: retention, employment, graduate employment. But none of these seeks to measure teaching excellence, nor is there an alternative measure proposed that does. There is no reference to a Retention, Employment and Graduate Employment Framework in the forthcoming Act, but there is a real danger that the REGEF is what we’ll get.   

John Cater is vice-chancellor of Edge Hill University.

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Featured Jobs

Most Commented

Monster behind man at desk

Despite all that’s been done to improve doctoral study, horror stories keep coming. Here three students relate PhD nightmares while two academics advise on how to ensure a successful supervision

celebrate, cheer, tef results

Emilie Murphy calls on those who challenged the teaching excellence framework methodology in the past to stop sharing their university ratings with pride

Sir Christopher Snowden, former Universities UK president, attacks ratings in wake of Southampton’s bronze award

Reflection of man in cracked mirror

To defend the values of reason from political attack we need to be more discriminating about the claims made in its name, says John Hendry

But the highest value UK spin-off companies mainly come from research-intensive universities, latest figures show