University Impact Rankings: FAQs

We answer some of your questions about the forthcoming Times Higher Education University Impact Rankings

September 6, 2018
Newton's cradle
Source: iStock

Times Higher Education is developing a new rankings to capture universities’ impact on society, based on institutions’ success in delivering the United Nations’ Sustainable Development Goals.

A new set of performance metrics will be developed and published as a league table at the THE Innovation and Impact Summit, which will be held at the Korea Advanced Institute of Science and Technology (KAIST) in South Korea in April 2019.

There will be a workshop on the first iteration of the methodology at THE’s World Academic Summit in Singapore later this month.

If you would like to submit data, ask questions or offer feedback, please contact us at innovation@timeshighereducation.com


General

 

What will the rankings do that other rankings do not do?

The Times Higher Education World University Rankings are designed for research-intensive global universities and are dominated by indicators of research excellence.

THE’s data team has also successfully pioneered new teaching-led rankings, focusing on teaching excellence and student success, in Japan and the United States (in partnership with The Wall Street Journal) and in Europe.

However, research and teaching are not universities’ only missions. As the UK’s knowledge exchange framework recently highlighted, a “third mission” revolves around knowledge transfer and innovation. This is increasingly becoming a hot topic and moving higher up policymakers’ agendas.

What is the THE University Impact Rankings about?

The THE University Impact Rankings will show how the global higher education sector is working towards the United Nations’ Sustainable Development Goals (SDGs).

Why is the THE University Impact Rankings important?

It provides a showcase for the work being delivered by universities in our communities, and it is an opportunity to shine a light on institutional activities and efforts not covered in other rankings. It will allow us to demonstrate the differences a university is making to the world we live in.

Can all institutions participate in this ranking?

This ranking is open to any higher education institution in the world. We want this ranking to be as inclusive as possible.

However, the first iteration will follow some broad participation criteria to allow us to make sensible comparisons. Thus, we will open data collection to any university that teaches at an undergraduate level and is validated by a recognised accreditation body.

We will also accept data from others outside this group for wider analysis and editorial purposes.

What is the time frame for this ranking?

The framework will be launched at our World Academic Summit in Singapore at the end of September 2018. Data collection via our data collection portal will commence shortly thereafter. The pilot ranking will be announced at the THE Innovation and Impact Summit in South Korea in April 2019.

What are the UN Sustainable Development Goals?

There are 17 SDGs, which were adopted by the UN in 2016 to provide a framework for developing the world in a sustainable way.

These include ending poverty and hunger; promoting good health and well-being and quality education; achieving gender equality and economic growth; providing access to clean water and sanitation and affordable and clean energy; fostering innovation; reducing inequalities; building sustainable cities and communities and achieving responsible consumption and production; tackling climate change; managing sustainably life below water and life on land; promoting peaceful societies; and revitalising global partnerships.

How will the ranking work?

The ranking is based on the 17 SDGs. Not every target relates directly to universities, but we believe that the higher education sector has a significant role to play in helping nations to deliver on the SDGs agenda. For each SDG, we have identified a limited set of metrics that can give an insight into progress.

In the first year, we plan to collect data on 11 of the 17 goals from participating universities. Universities will be able to provide data on one or more of the SDGs.

We will produce an overall ranking of universities based on data on the goal of revitalising global partnerships (the only mandatory goal) plus the best three SDGs per university. This will allow universities to demonstrate their excellence in the areas that are most relevant to them, their community and their country.

Individual rankings of the universities that are best achieving the 11 SDGs will also be published.

My university isn’t active (or doesn’t record data) across all SDGs – is it worth participating?

Not all universities will be able to report on all the metrics covered in the rankings. To be included in the overall ranking, we ask that you submit data on revitalising global partnerships, which is mandatory, and at least three other SDGs of your choice.

A university that submits data in fewer than three other SDGs cannot be included in the overall ranking. However, it can still be ranked in the tables on individual goals. For example, if you have done great work on climate action, then submitting in that category alone would enable you to be ranked for it.

What happens if we submit data for more than three SDG areas?

We will evaluate your performance in all areas and then choose the three goals in which you excel; these will count towards the overall university score.

How many rankings will you produce?

THE will use provided data to produce:

  • An overall ranking of universities based on the top three SDGs for each individual university, plus SDG 17 (revitalising global partnerships)
  • Individual rankings of universities based on performance in each SDG

Are other stakeholders involved in this ranking?

We are collaborating with experts in the field, including Vertigo Ventures, an organisation that helps leading research institutions globally to identify, capture and report the impact of their work, and with Mastodon C, a data science and data engineering business. We will also be consulting with higher education institutions.

 

 

Methodology

 

What is the rankings methodology?

The THE University Impact Rankings is created using the UN Sustainable Development Goals as reference. In year one, our pilot ranking, we will focus on a subset of 11 SDGs: global partnerships as a mandatory field, in addition to good health and well-being; quality education; gender equality; decent work and economic growth; industry, innovation and infrastructure; reduced inequalities; sustainable cities and communities; responsible consumption and production; climate action; and peace, justice and strong institutions.

Each SDG has a small number of metrics associated with it.

These 11 SDGs were chosen after THE conducted research, consulted with higher education institutions, and worked with experts in the field.

Data will come from a variety of sources, including:

  • Direct submissions from institutions
  • Bibliometric datasets from Elsevier
  • And, possibly, a reputation survey

The overall score will be calculated by counting SDG 17 (revitalising global partnerships) as a mandatory data field and combining this with data on the best three SDGs per university.

There are no weightings assigned yet, but we will not prioritise one SDG over the others. SDGs are of equal importance, and our ambition is to weight all SDGs equally.

Won’t this just favour big, established universities?

We have tried to define the metrics in a way that allows all universities to participate – this has included focusing on definitions that rely on less complex calculations than in an ideal world. We have also tried to ensure that the choice of metrics is not overly biased towards wealth.

As with the World University Rankings, we will normalise for university size where appropriate, and use other measures to ensure equity between different countries and universities.

How did you come up with methodology?

THE has been discussing aspects of university impact for several years. This has included a lengthy consultation with interested parties, culminating in an open session at the THE Young Universities Summit in Florida in June 2018.

Other crucial aspects informing our decision were feasibility and access to data.

Although we will launch the first edition based on 11 of the SDGs, we hope to include the other six SDGs in subsequent versions.

 

 

Data collection and validation

Data collection 

 

What are your data sources?

  • We invite universities to submit data in a subset of SDGs
  • For each SDG, there will be some data that are collected from universities, and bibliometric data provided by Elsevier
  • A reputation survey will also potentially provide data

How will you validate the data?

Universities will be asked to provide evidence or documentation to support their submissions. Clarifications and/or URLs to sites with evidence are requested under the caveat section and/or the data submission section in the portal.

Information will be cross-checked against external sources at our discretion, and we reserve the right to investigate institutions where we believe inappropriate data collection or submission has taken place.

We encourage universities to publish their evidence, and in many cases we expect the evidence to be sourced from existing public sources, for example, annual reports.

What types of evidence do you accept?

We accept links to documents or websites that contain proof of information provided.

If provided documents are confidential, universities must explicitly indicate this in the caveats.

Do universities have to submit data for all SDGs in order to participate?

Only SDG 17 (global partnerships) is a mandatory data field.

Otherwise, universities may submit data on as many SDGs as they would like or are able to.

We don’t have all the data needed for a specific SDG – what will happen?

We do not plan to do imputation of missing data. If you don’t have specific data, then you can still be ranked in that SDG, but will score at a lower level than institutions that are able to provide the data. We would encourage you to provide data wherever you can, and to look to record data for future years too.

Do you have a detailed description of the data fields?

We are providing a data collection portal guide that explains key aspects of the process, including data field definitions.

If you have any queries, please send your questions to: innovation@timeshighereducation.com

Will participating institutions be able to benchmark their data against peers?

Yes. There will be opportunity for benchmarking, but this process is yet to be determined.

 

Please login or register to read this article

Register to continue

Get a month's unlimited access to THE content online. Just register and complete your career summary.

Registration is free and only takes a moment. Once registered you can read a total of 3 articles each month, plus:

  • Sign up for the editor's highlights
  • Receive World University Rankings news first
  • Get job alerts, shortlist jobs and save job searches
  • Participate in reader discussions and post comments
Register

Have your say

Log in or register to post comments