University Impact Rankings: FAQs

We answer your questions about the Times Higher Education University Impact Rankings

September 17, 2019
Newton's cradle
Source: iStock

Times Higher Education’s University Impact Rankings capture universities’ impact on society based on institutions’ success in delivering the United Nations’ Sustainable Development Goals.

A set of performance metrics was developed last year and published as a league table at the THE Innovation and Impact Summit held at the Korea Advanced Institute of Science and Technology (KAIST) in South Korea in April 2019.

We have now confirmed the metrics for the THE University Impact Rankings 2020, which will be based on all 17 SDGs. A document detailing the new metrics is attached at the bottom of this article.

If you would like to submit data, ask questions or offer feedback, please contact us at impact@timeshighereducation.com

You can discover more about how we are evaluating impact in this rankings blog.


Watch our webinar on the THE University Impact Rankings

Note: The slides are attached at the bottom of the article


General

 

What does this rankings do that other rankings do not do?

The Times Higher Education World University Rankings are designed for research-intensive global universities and are dominated by indicators of research excellence.

THE’s data team has also successfully pioneered new teaching-led rankings, focusing on teaching excellence and student success, in Japan, in the United States (in partnership with The Wall Street Journal) and in Europe.

This rankings, however, explores the impact that a university can make, specifically by looking at themes of sustainability.

What is the THE University Impact Rankings about?

The THE University Impact Rankings shows how the global higher education sector is working towards the United Nations’ Sustainable Development Goals (SDGs).

Why is the THE University Impact Rankings important?

It provides a showcase for the work being delivered by universities in our communities, and it is an opportunity to shine a light on institutional activities and efforts not covered in other rankings. It will allow us to demonstrate the differences a university is making to the world we live in.

Can all institutions participate in this ranking?

This ranking is open to any higher education institution in the world. We want this ranking to be as inclusive as possible.

Data collection is open to any university that teaches at an undergraduate level and is validated by a recognised accreditation body.

We will also accept data from others outside this group for wider analysis and editorial purposes.

This is different from the THE World University Rankings, which includes a minimum publication volume as part of the eligibility criteria.

If an institution does not provide any data, it will not be ranked.

What is the time frame for this ranking?

The first version of the University Impact Rankings was launched in April 2019. Data collection for 2020 via our data collection portal will open in October 2019.

What are the UN Sustainable Development Goals?

There are 17 SDGs, which were adopted by the UN in 2016 to provide a framework for developing the world in a sustainable way.

These include ending poverty and hunger; promoting good health and well-being and quality education; achieving gender equality and economic growth; providing access to clean water and sanitation and affordable and clean energy; fostering innovation; reducing inequalities; building sustainable cities and communities and achieving responsible consumption and production; tackling climate change; managing sustainably life below water and life on land; promoting peaceful societies; and revitalising global partnerships.

How will the ranking work?

The ranking is based on the 17 SDGs. Not every target in the SDGs relates directly to universities, but we believe that the higher education sector has a significant role to play in helping nations to deliver on the SDGs agenda. For each SDG, we have identified a limited set of metrics that can give an insight into progress.

In the first year, we collected data on 11 of the 17 goals from participating universities. For 2020, we are expanding this to all 17 SDGs.

Universities may provide data on one or more of the SDGs.

We produce an overall ranking of universities based on institutions’ data on SDG 17 (the only mandatory goal) plus their top three scores on the remaining SDGs. This will allow universities to demonstrate their excellence in the areas that are most relevant to them, their community and their country.

Rankings of the universities that are best achieving the individual SDGs will also be published.

My university is not active (or does not record data) across all SDGs – is it worth participating?

Not all universities will be able to report on all the metrics covered in the rankings. To be included in the overall ranking, we ask that you submit data on SDG 17, which is mandatory, and at least three other SDGs of your choice.

A university that submits data in fewer than three other SDGs cannot be included in the overall ranking. However, it can still be ranked in the tables on individual goals. For example, if you have done great work on climate action, submitting in that category alone would enable you to be ranked for it.

The ranking will reflect local activities as well as international activities.

What happens if we submit data for more than four SDG areas?

We will evaluate your performance in all areas and then choose the three goals in which you excel; these will count towards the overall university score.

How many rankings will THE produce?

THE will use provided data to produce:

  • An overall ranking of universities based on the top three SDGs for each individual university, plus SDG 17 (revitalising global partnerships)
  • Individual rankings of universities based on performance in each SDG

Are other stakeholders involved in this ranking?

We are collaborating with experts in the field, including Vertigo Ventures, an organisation that helps leading research institutions globally to identify, capture and report the impact of their work. Our bibliometric supplier is Elsevier. We are also consulting with higher education institutions and groups to help us better define our metrics.

 

 

Methodology

 

What is the rankings methodology?

The THE University Impact Rankings is created using the UN Sustainable Development Goals as reference.

Each SDG has a small number of metrics associated with it.

Data will come from a variety of sources, including:

  • Direct submissions from institutions
  • Bibliometric datasets from Elsevier

The overall score will be calculated by counting SDG 17 (revitalising global partnerships) as a mandatory data field and combining this with data on the best three SDGs per university.

Won’t this just favour big, established universities?

We have tried to define the metrics in a way that allows all universities to participate – this has included focusing on definitions that rely on less complex calculations than in an ideal world. We have also tried to ensure that the choice of metrics is not overly biased towards wealth.

As with the World University Rankings, we will normalise for university size where appropriate, and use other measures to ensure equity between different countries and universities.

How did you come up with methodology?

THE has been discussing aspects of university impact for several years. This has included a lengthy consultation with interested parties, culminating in an open session at the THE Young Universities Summit in Florida in June 2018.

Other crucial aspects informing our decision were feasibility and access to data.

 

 

Data collection and validation

Data collection 

 

What are your data sources?

  • We invite universities to submit data in a subset of SDGs.
  • For each SDG, there will be some data that are collected from universities as well as bibliometric data provided by Elsevier.

How will you validate the data?

Universities will be asked to provide evidence or documentation to support their submissions. Clarifications and/or URLs to sites with evidence are requested under the caveat section and/or the data submission section in the portal.

Information will be cross-checked against external sources at our discretion, and we reserve the right to investigate institutions where we believe inappropriate data collection or submission has taken place.

We encourage universities to publish their evidence, and in many cases we expect the evidence to be sourced from existing public sources, for example, annual reports.

Our team of analysts will compare evidence that is provided to the definitions, and it will be marked accordingly.

What types of evidence do you accept?

We accept links to documents or websites that contain proof of information provided.

If provided documents are confidential, universities must explicitly indicate this in the caveats.

We do not expect universities to submit all the evidence in English.

Must universities submit data for all SDGs in order to participate?

Only SDG 17 (global partnerships) is a mandatory data field.

Otherwise, universities may submit data on as many SDGs as they would like or are able to.

We do not have all the data needed for a specific SDG – what will happen?

We do not plan to do imputation of missing data. If you do not have specific data, you can still be ranked in that SDG but will score at a lower level than institutions that are able to provide data. We would encourage you to provide data wherever you can, and to look to record data for future years, too.

Do you have a detailed description of the data fields?

We are providing a data collection user guide that explains key aspects of the process, including data field definitions.

If you have any queries, please send your questions to: impact@timeshighereducation.com

Will participating institutions be able to benchmark their data against peers?

Yes. There will be opportunity for benchmarking, but this process is yet to be determined.

 


Reader's comments (1)

This is a great initiative to address the societal responsibilities of universities. The "third mission", namely, innovation and impact directly benefiting society and sustainable development is hard to measure and often overlooked in universities' strategy. The new ranking will bring about more balance into the missions of universities. Well done to THE and look forward to seeing this new ranking launched next April. Max Lu -President and Vice-Chancellor, University of Surrey

欢迎反馈

Log in or register to post comments

评论最多

赞助

推荐职位

Academic Registry

University Of Surrey

Head of Digital

St Marys University, Twickenham

DTA3 MSCA Research Fellow

University Of Central Lancashire