NSS 'yea-saying' may be due to image-conscious universities

Study says that importance of survey results may lead to ‘overzealous promotion’ and encourage more generous responses

October 8, 2015
Man pulling face into fake smile

Growing numbers of university leavers may be giving the same response to every question on the National Student Survey because of “overzealous promotion” by institutions concerned about their public profile, a study suggests.

In 2014, 6.1 per cent of those completing the NSS online gave the same answer to every question – a phenomenon known as “yea-saying” – up from 1 per cent in 2005. The majority of these responses comprise wholly positive ratings.

A report to the UK’s higher education funding councils by polling organisation Ipsos MORI, which conducts the NSS, says that the “worrying” trend “may continue”, because yea-saying is even more prevalent among graduates who complete the survey on a smartphone, a category that is expected to grow.

One interpretation is that yea-saying reflects students trying to answer the survey as quickly as possible, and Ipsos MORI found evidence to support this.

Yea-sayers completed the 2014 survey in an average time of five and a half minutes, compared with eight and a half minutes for respondents who gave more varied responses. One in five yea-sayers completed the survey in under two minutes, compared with only 3 per cent of the rest of the sample.

But other evidence suggests there might be something more to it, as although yea-sayers were less likely to answer optional questions than other respondents, some 68 per cent still did, and more than half gave open-ended comments.

Ipsos MORI says that institutions are “aware of the importance of the survey and the visibility of the results, especially in the media and league tables”. This, the report says, “may encourage some overzealous promotion” of the NSS, and “could lead students to rate their institutions more generously”.

“Strong NSS scores at the institutional level can benefit both students and institutions themselves…there may therefore be some incentive on the part of both to encourage or give positive ratings,” the report says.

One possible solution would be to introduce negatively worded questions, to encourage more considered responses, but in a pilot students found these questions confusing.

A review chaired by Janet Beer, vice-chancellor of the University of Liverpool, instead recommends changes to the design of the survey interface. A “drag and drop” method of answering questions, or a warning if the same answer is given too many times, may be introduced. 


You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 6 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Related universities


Print headline: NSS ‘yea-saying’: is institutional zeal to blame?

Reader's comments (2)

Pressure is sometimes brought to bear against students to force them to rate positively, as was the case a few years back when Kingston University was caught doing this. Such surveys should be answered in an environment where there are no staff present.
What this article doesn't mention is that (according to a Hefce presentation at the 2015 HESPA conference) the vast majority of these 'yea-sayers' definitely agree with the question statements in the NSS, meaning that they are students who are very satisfied with all aspects of their undergraduate experience. Can this not be understood to perhaps suggest that the introduction of the survey has surfaced issues within institutions, and enabled management to act on them, meaning that more students are now completely satisfied than in the past? If 68% of these 'yea sayers' are taking the time to type optional comments - that suggests full engagement with the process. I would argue that if you are very happy with your experience, you don't really need to take long to think about which box to tick, but if your experience is not polarised (really good, or really bad) it is likely that it would take you longer to decide which column to select. And this may well explain the reduced time spent by some of these 'yea-sayer' students in completing the survey, rather then undermining the validity of their results.

Have your say

Log in or register to post comments

Featured Jobs

Lecturer/Assistant Professor of Psychology UNIVERSITY COLLEGE DUBLIN (UCD)
Lecturer/Assistant Professor of Geography UNIVERSITY COLLEGE DUBLIN (UCD)
Lecturer/Assistant Professor of Economics UNIVERSITY COLLEGE DUBLIN (UCD)
Lecturer/Assistant Professor (BDIC) UNIVERSITY COLLEGE DUBLIN (UCD)
Lecturer/Assistant Professor in Social Work UNIVERSITY COLLEGE DUBLIN (UCD)

Most Commented

Home secretary says government will support 'best' universities

Man handing microphone to audience member

Academic attainment of disadvantaged students can be improved if they can decide how they are assessed, study claims

Woman drinking tea from saucer

Plugging a multibillion-pound deficit exacerbated by June’s poll result may require ‘drastic measures’, analysts have warned

Italy's gold medallist

New measures to ensure universities are ‘not penalised’ for taking poorer students also outlined for next stage of TEF

Classroom, school

Higher education institutions can and should do more to influence education at a secondary school level, says Edward Peck