Job Summary

The Caltech Center for Teaching, Learning, and Outreach (CTLO) supports the Institute’s multifaceted educational efforts, including both university-level teaching and educational programs for K-12 students and teachers. The Assessment and Evaluation Specialist (AES) is a half-time, one-year position focused on educational assessment of a range of CTLO programs and services.

The AES will be responsible for completing both formative assessment and summative evaluation of selected CTLO initiatives. The AES will work with CTLO staff to plan and conduct various aspects of studies, including developing or adapting assessment instruments, obtaining IRB approval and informed consent, and collecting and analyzing data. The AES will report and discuss their assessment and evaluation results with members of the CTLO team and other institutional representatives. The AES will also provide guidance in developing assessment instruments, evaluation procedures, and data analysis procedures that can be used by CTLO in the future. The AES will contribute to writing grant reports and incorporating findings into funding proposals.

Job Duties

• Plan, design, and conduct assessment of intended outcomes (e.g., learning outcomes, affective outcomes, teaching outcomes, behavioral outcomes) associated with CTLO efforts.
• Match, clean, disaggregate, and analyze datasets consisting of CTLO data plus other institutional data (e.g., student outcomes, teaching evaluations).
• Conduct holistic evaluations of selected CTLO projects and initiatives.
• Design survey instruments to use in the assessment of CTLO projects and initiatives.
• Collect data through various means, such as classroom observations, survey instruments, and student assessments.
• Manage informed consent and required institutional review board (IRB) permissions.
• Develop reports, including program improvement recommendations.
• Provide leadership regarding effective models, methods, and systems for evaluation and assessment of CTLO programs.
• Attend and/or present at internal meetings as assigned or requested.
• Collaborate on funder reports and proposal development.
• Perform related work as required.

Basic Qualifications

• Master's degree in education, STEM education, educational measurement, assessment and evaluation, or similar field.
• 3 years successful experience in STEM education program assessment and evaluation; experience in real-world program assessment and evaluation obtained during post-baccalaureate study may count for some experience, though at least one year of experience must come from independent, non-degree related work.
• Experience in qualitative and quantitative educational data collection and analysis; data management and analysis; measurement theories; and survey design, development, validity, and reliability.
• Prior training and certification in human subjects research, with a focus in social/behavioral/educational research (e.g., through CITI or other known provider).
• Thorough knowledge of modern principles, practices, and procedures of educational assessment and program evaluation practices.
• Knowledge of current K-12 and university STEM education issues, including those related to recruitment, retention, diversity, equity, and inclusion.
• Ability to communicate ideas clearly and concisely, orally and in writing, including strong report writing and data visualization skills.
• Ability to establish and maintain effective relationships with staff and administration.
• Strong project management skills.

Preferred Qualifications

• Successful experience as an independent evaluator of STEM education programs or projects.
• Membership or leadership in relevant professional organizations or associations.
• Exemplary writing evidenced by published reports or articles in professional journals.

Required Documents

• Curriculum Vitae (CV)
• Cover letter describing experience relevant to the job duties and qualifications