Verdict on QAA reform: amateurish and daft

Plans to use satisfaction surveys to trigger reviews have raised eyebrows, writes Simon Baker

July 7, 2011



Credit: Getty
Awaiting inspection: Not scrutinising universities regularly risks seriously damaging the UK's status in the world of higher education, says former QAA chief Peter Williams


The government has been criticised for a "high level of amateurishness" in formulating proposals on quality assurance in the higher education White Paper.

The suggestion that student surveys could trigger reviews was also dismissed as "daft".

As part of plans to move the work of the Quality Assurance Agency towards a "risk-based" system, the policy document proposes that the use of institutional reviews could depend on an "objective set of criteria and triggers", including student satisfaction.

The White Paper does not specifically mention the National Student Survey - which has been criticised in the past for its reliability in measuring quality - as a potential trigger.

But Peter Williams, former chief executive of the QAA, said that there would be serious question marks if satisfaction ratings were used to determine the need and frequency of institutional reviews.

He said that although surveys such as the NSS might be a useful tool in some respects, they were completely unsuitable for use in a quality assurance regime because of the concentration of most scores into a narrow band of results.

"Student satisfaction is not a criterion for good quality and is certainly not a criterion for assessing academic standards," he said, adding that the authors of the White Paper appeared to have "no real idea of what quality assurance is for".

"I get the impression that there is a high level of amateurishness in the White Paper's treatment of the quality assurance question."

He also warned that the reputation of English higher education would suffer if a risk-based system led to some universities not being inspected regularly.

"If there is an extended period of time during which universities will not be subject to any kind of review, then this is going to seriously damage the UK's status in the world of higher education," said Mr Williams, who was head of the QAA from 2002 to 2009.

Roger Brown, professor of higher education policy at Liverpool Hope University, said he had "never heard anything so daft in all my life" in response to the idea of student satisfaction triggering reviews. Survey scores, he said, were "desperately unreliable" and the only "secure basis" for maintaining quality was to have a clear set of sanctions for wayward universities by, for example, threatening the removal of degree-awarding powers.

Anthony McClaran, current chief executive of the QAA, said the detail of how risk might be measured in any future framework would be subject to the consultation on regulation that the government is expected to launch in a few weeks.

However, he said he could envisage risk being measured in several ways: bodies such as the Office of the Independent Adjudicator could flag specific concerns, but indicators such as student satisfaction, a university's finances or its governance could also prompt alerts.

"If there were consistently poor scores or declining scores on student satisfaction for a particular institution, that might trigger a closer examination," he said.

He added that indicators would have to be "robust" and he stressed that the QAA already made sure it substantiated evidence when inspections were triggered under its current procedure for investigating student concerns about a university.

simon.baker@tsleducation.com

It's good to talk

The White Paper has set in motion a large number of new reviews and consultations. They include:

Consultations

• Overall higher education strategy set out in the White Paper. Ends in September

• Options for the early repayment of student loans. Ends in September

• Allocation of teaching grant and student numbers in 2012-13. Ends in September

• Distribution of remaining teaching grant from 2013-14 and how to allocate places for part-time students and private providers. Starts this winter and will take 12 weeks

• Future regulatory regime. End of July until October

• Treasury consultation on removing VAT barrier to shared services. Continuing.

Reviews

• Sir Tim Wilson to undertake a review of collaboration between universities and employers

• Financial advisers Rothschild to lead a feasibility study into selling off the student loan book

• Steering group to consider whether National Student Survey should cover postgraduates

• Group on better regulation to look at reducing red tape and make proposals by November

• Review of participation in postgraduate study once undergraduate system "beds in".

You've reached your article limit.

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments

Most Commented

Worried man wiping forehead
Two academics explain how to beat some of the typical anxieties associated with a doctoral degree

Felipe Fernández-Armesto takes issue with a claim that the EU has been playing the sovereignty card in Brexit negotiations

Man throwing axes

UCU attacks plans to cut 171 posts, but university denies Brexit 'the reason'

Kenny Dalglish

Agnes Bäker and Amanda Goodall have found that academics who are happiest at work have a head of department who is a distinguished researcher. How can such people be encouraged into management?

A group of flamingos and a Marabou stork

A right-wing philosopher in Texas tells John Gill how a minority of students can shut down debates and intimidate lecturers – and why he backs Trump