World Reputation Rankings 2014 methodology

March 6, 2014

Census sensibility reveals the global academy’s greatest names

Which universities do scholars think are the best on the planet? This is no idle question, as our annual Academic Reputation Survey demonstrates

The Times Higher Education World Reputation Rankings are created using the world’s largest invitation-only academic opinion survey – a unique piece of research.

The Academic Reputation Survey, available in 10 languages, uses United Nations data to ensure that it is properly distributed to reflect the demographics of world scholarship. It is also evenly spread across academic disciplines.

Those invited to take part are statistically representative of both their country and their discipline.

The questionnaire, administered by polling company Ipsos MediaCT for THE’s rankings data supplier Thomson Reuters, targets only experienced, published scholars, who offer their views on excellence in research and teaching within their disciplines and at institutions with which they are familiar.

The 2014 rankings are based on a survey carried out between March and May 2013, which received 10,536 responses from 133 countries.

When polled, the respondents on average had been working in the academy for 18 years.

With 13,388 answers to the first Academic Reputation Survey in 2010, 17,554 in 2011 and 16,639 in 2012, more than 58,000 detailed expert responses from more than 150 countries have now been collected in just four annual rounds.

There is a balanced spread of responses across disciplines. In 2014, the most have come from the social sciences and from engineering and technology (22 per cent each), followed by the physical sciences (18 per cent), clinical subjects (16 per cent), the life sciences (13 per cent), then the arts and humanities (9 per cent).

The spread across the regions is also well balanced: 25 per cent of responses hail from North America, 19 per cent from Western Europe, 13 per cent from East Asia, 10 per cent from Oceania, 10 per cent from Eastern Europe, 5 per cent from the Middle East and 4 per cent from South America.

In the survey, scholars are questioned at the level of their specific subject discipline. They are not asked to create a ranking or to list a large range of institutions, but to name no more than 15 of those they believe to be the best, based on their own experience.

The survey data were used alongside 11 objective indicators to help create the World University Rankings 2013-2014, which were unveiled in October last year. The reputation data are published alone each year to create the World Reputation Rankings.

Calculating the scores

The reputation table ranks institutions according to an overall measure of their esteem that combines data on their reputation for research and for teaching.

The two scores are combined at a ratio of 2:1, giving more weight to research because feedback from our expert advisers suggests that there is greater confidence in respondents’ ability to make accurate judgements about research quality.

The scores are based on the number of times an institution is cited by respondents as being the best in their field. The number one institution, Harvard University, was selected most often. The scores for all other institutions in the table are expressed as a percentage of Harvard’s, set at 100. For example, the University of Oxford received 67.8 per cent of the number of nominations that Harvard received, giving it a score of 67.8 against Harvard’s 100. This scoring system, which is different from the one used in the World University Rankings, is intended to provide a clearer and more meaningful perspective on the reputation data in isolation.

The top 100 universities by reputation are listed, but Times Higher Education has agreed with data supplier Thomson Reuters to rank only the top 50 because the differentials between institutions after that point become very narrow. The institutions that make up the second half of the table are listed in groups of 10, in alphabetical order. Scores are given to one decimal place, but were calculated to greater precision.

Survey invite: RSVP

The Academic Reputation Survey that will inform the 2014-15 World University Rankings and the 2015 World Reputation Rankings will be distributed soon. If selected to take part, you will represent your country and discipline in an important piece of research. Please put aside 20 minutes to fill in the form.

You've reached your article limit

Register to continue

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments

Have your say

Log in or register to post comments

Most Commented

Laurel and Hardy sawing a plank of wood

Working with other academics can be tricky so follow some key rules, say Kevin O'Gorman and Robert MacIntosh

Lady Margaret Hall, Oxford will host a homeopathy conference next month

Charity says Lady Margaret Hall, Oxford is ‘naive’ to hire out its premises for event

women leapfrog. Vintage

Robert MacIntosh and Kevin O’Gorman offer advice on climbing the career ladder

Woman pulling blind down over an eye
Liz Morrish reflects on why she chose to tackle the failings of the neoliberal academy from the outside
White cliffs of Dover

From Australia to Singapore, David Matthews and John Elmes weigh the pros and cons of likely destinations