About the position

We offer a 3 or 4 (with teaching duties) year fully funded PhD position at the Information Systems and Software Engineering (ISSE) group of the Department of Computer Science, NTNU. The focus of this position is on the exploring the use of Artificial Intelligence (AI) and Natural Language Processing (NLP) techniques in the frame of response technology applied in educational settings. More specific, the aim is to identify methods, models and visualizations that allow open text questions to be used in interactive lectures in an efficient manner. The position is related to work taking place in the Excited Centre for Excellent IT Education. 

In general, response technology is reported in literature as a driver of positive change that promotes ownership and engagement. While using multiple choice questions is fairly simple and straightforward, free text questions pose a set of challenges that are on one hand related to the relatively large variability in expression using text and on the other hand to the amount of information that is too large to be processed efficiently in front of an audience. 

AI and NLP have the potential to greatly improve how we provide feedback on text gathered with response technology (RT) from (relatively) large audiences. The amount of information, as provided, is usually large and hard to process in front of an audience. AI and NLP can be used to structure and simplify results into an immediately manageable format that can alleviate the heavy cognitive load that otherwise such questions would impose on the lecturer. This can improve the dialog driven by such questions. An example might be a teacher that wants to provide meaningful feedback to a (relatively) large group of students in a lecture hall. 

The problem: using open text questions with response technology in classroom is not feasible with large classrooms and it does not scale up. In a typical scenario, the teacher asks an open text question during the lecture and the students will reply using their devices (smartphones, tablets, laptops) within a given time. The challenge is to automatically organize and visualize the answers so that the teacher can use this information to steer the lecture in the most useful direction without a significant delay in the lecture. There are 2 main cases: a) the question is prepared and there are already defined some topics of interest and b) the question is ad-hoc and there is no prepared set of topics. A typical set of answers can range from 50 answers to 700+ depending on the size of the classroom. The answers are, most often than not, formed in a couple short sentences or sometimes just a list of keywords. There are often typos and SMS like spelling and abbreviations.

The ideal candidate will be able to approach this topic from a broad perspective that combines AI/NLP, response technology and education.  To do so, a combination of prototype development and both quantitative and qualitative research methods will be employed. The aim of this project is to understand how such an approach could impact response technology applied in education. We are looking for candidates with a strong research perspective that can publish their work in leading academic journals and conference proceedings.

The position reports to Head of Department.

Duties of the position

The goal of this project is to explore the potential value of employing AI / NLP techniques to create new possibilities for using open text questions in interactive lectures. This work will build on an interdisciplinary approach, bridging the domains of IT applied in education and AI/NLP. The successful candidate is expected to have a strong background in AI / NLP, be knowledgeable about research methods and competent in quantitative research techniques. The suitable candidate should also have experience with reading and reflecting on research papers in the domains of IT in education and AI/NLP. We are seeking a highly motivated individual that wants to excel in a research environment and has strong academic ambitions. The PhD candidate will therefore contribute to generate knowledge regarding the use and deployment of AI in educational settings to enhance response technology. Part of the main duties and responsibilities include conducting the following:

• perform literature reviews and be able to synthesize knowledge.
• develop prototypes and test them with real users.
• create AI models and integrate them in prototypes and services.
• conduct interviews and focus groups with relevant stakeholders.
• collect, analyze and interpret quantitative data with the use of statistical analysis software.
• communicate and disseminate results to academic and non-academic stakeholders.

Required selection criteria

The PhD-position's main objective is to qualify for work in research positions. The qualification requirement is that you have completed a master’s degree or second degree (equivalent to 120 credits) with a strong academic background in Computer Science or equivalent education with a grade of B or better in terms of NTNU’s grading scale. If you do not have letter grades from previous studies, you must have an equally good academic foundation. If you are unable to meet these criteria you may be considered only if you can document that you are particularly suitable for education leading to a PhD degree.

The appointment is to be made in accordance with the regulations in force concerning State Employees and Civil Servants and national guidelines for appointment as PhD, post doctor and research assistant.

Other required qualifications:

• The applicant must have a strong background in AI / NLP.
• The applicant’s master thesis must be research-oriented.
• A strong background in research methods - knowledge on qualitative and quantitative techniques and statistical analysis is required.
• Excellent English - written and oral communication skills.

Applicants who do not master a Scandinavian language must provide evidence of good English language skills, written and spoken.

The following tests can be used as such documentation: TOEFL, IELTS or Cambridge Certificate in Advanced English (CAE) or Cambridge Certificate of Proficiency in English (CPE). Minimum scores are:

• TOEFL: 600 (paper-based test), 92 (Internet-based test)
• IELTS: 6.5, with no section lower than 5.5 (only Academic IELTS test accepted)
• CAE/CPE: grade B.

Preferred selection criteria

•  Experience with IT applied in education or response technology will be considered a plus.
•  Experience with AI  applied to analyze text will be considered a plus.
•  Publication activities in relevant disciplines will be considered an advantage.

Personal characteristics

The candidate:

• is good at anticipating problems and identifying logical solutions as well as contradictions and inconsistencies.
• develops effective, sensible and practical solutions to problems.
• is positive and enthusiastic, even in difficult situations.
• works constructively under pressure in the face of setbacks.
• sets challenging goals and works hard to achieve them.
• enjoys working in a team-based environment, but is also able to conduct independent activities and thinking.

We offer

• exciting and stimulating tasks in a strong international academic environment
• an open and inclusive work environment with dedicated colleagues
• favourable terms in the Norwegian Public Service Pension Fund
• employee benefits

Salary and conditions

PhD candidates are remunerated in code 1017, and are normally remunerated at gross from NOK 482 200 per annum before tax, depending on qualifications and seniority. From the salary, 2% is deducted as a contribution to the Norwegian Public Service Pension Fund.

The period of employment is 3 or 4 (with teaching duties) year.

Appointment to a PhD position requires that you are admitted to the PhD programme in Computer Science within three months of employment, and that you participate in an organized PhD programme during the employment period. 

The engagement is to be made in accordance with the regulations in force concerning State Employees and Civil Servants, and the acts relating to Control of the Export of Strategic Goods, Services and Technology. Candidates who by assessment of the application and attachment are seen to conflict with the criteria in the latter law will be prohibited from recruitment to NTNU. After the appointment you must assume that there may be changes in the area of work.

It is a prerequisite you can be present at and accessible to the institution on a daily basis.

About the application

The application and supporting documentation to be used as the basis for the assessment must be in English.

Publications and other scientific work must follow the application. Please note that applications are only evaluated based on the information available on the application deadline. You should ensure that your application shows clearly how your skills and experience meet the criteria which are set out above. 

The application must include:

• Curriculum vitae (CV) with information about the candidate’s prior training, exams, and work experience
• Certified copies of transcripts and diplomas for the whole bachelor and master’s degree. An English translation of all education documents is required unless the documents are in Norwegian or English.
• Applicants from universities outside Norway are kindly requested to send a diploma supplement or a similar document that describes in detail the study and grading system and the rights for further studies associated with the obtained degree.
• Research proposal (max. 6 pages) including:
  • A short presentation of the motivation for a PhD study.
  • How the applicant sees his/her background suitable.
  • The applicant’s view of research challenges within the area of the PhD position.
  • How the competence of the applicant can contribute to solving these challenges.
  • Present an idea of how this type of problem may be addressed. Please describe how you plan to solve the problem, outlined in the call, based on the requirements presented and through the perspective of your background. Highlight specific elements from your background that you plan to leverage and build upon. 
  • Be clear and concise and try to fit your proposal in 5-6 pages (ca. 2500 words) excluding cover page, references and figures/tables. Use a sans serif font such as Calibri font size 11 spaced at 1.5. For the references and citations use APA style.
• Names and contact information of at least 3 reference persons.
• A copy of the master thesis (in PDF), or, for those who are near to completion of their MSc, an extended abstract combined with a statement of how and when the applicant plans to complete the thesis.
• Attachments of any other relevant documents (e.g. certificates, diplomas, publications)
• Academic works - published or unpublished - that you would like to be considered in the assessment (up to 3 works).

Incomplete applications will not be considered.

Joint works will be considered. If it is difficult to identify your contribution to joint works, you must attach a brief description of your participation.

In the evaluation of which candidate is best qualified, emphasis will be placed on education, experience and personal suitability.

NTNU is committed to following evaluation criteria for research quality according to The San Francisco Declaration on Research Assessment - DORA.

General information

Working at NTNU

A good work environment is characterized by diversity. We encourage qualified candidates to apply, regardless of their gender, functional capacity or cultural background. 

The city of Trondheim is a modern European city with a rich cultural scene. Trondheim is the innovation capital of Norway with a population of 200,000. The Norwegian welfare state, including healthcare, schools, kindergartens and overall equality, is probably the best of its kind in the world. Professional subsidized day-care for children is easily available. Furthermore, Trondheim offers great opportunities for education (including international schools) and possibilities to enjoy nature, culture and family life and has low crime rates and clean air quality.

As an employee at NTNU, you must at all times adhere to the changes that the development in the subject entails and the organizational changes that are adopted.

Information Act (Offentleglova), your name, age, position and municipality may be made public even if you have requested not to have your name entered on the list of applicants.

If you have any questions about the position, please contact Associate Professor George Adrian Stoica , telephone +47 73412088 , email: stoica@ntnu.no or Head of Department Professor John Krogstie, e-mail: John.Krogstie@ntnu.no. 

Please submit your application electronically via jobbnorge.no with your CV, diplomas and certificates. Applications submitted elsewhere will not be considered. Diploma Supplement is required to attach for European Master Diplomas outside Norway. Chinese applicants are required to provide confirmation of Master Diploma from China Credentials Verification (CHSI).

If you are invited for interview you must include certified copies of transcripts and reference letters. Please refer to the application number 2019/38334 when applying.

Application deadline: 31.05.2021.

NTNU - knowledge for a better world

The Norwegian University of Science and Technology (NTNU) creates knowledge for a better world and solutions that can change everyday life.

Department of Computer Science

We are the leading academic IT environment in Norway, and offer a wide range of theoretical and applied IT programmes of study at all levels. Our subject areas include hardware, algorithms, visual computing, AI, databases, software engineering, information systems, learning technology, HCI, CSCW, IT operations and applied data processing. The Department has groups in both Trondheim and Gjøvik. The Department of Computer Science is one of seven departments in the Faculty of Information Technology and Electrical Engineering .

Deadline 31st May 2021
Employer NTNU - Norwegian University of Science and Technology
Municipality Trondheim
Scope Fulltime
DurationTemporary
Place of service Campus Gløshaugen