Assessment and Evaluation Specialist
Job Category Parttime Temporary
ExemptOvertimeEligible Overtime Eligible
Benefits Eligible Benefit Based
Caltech is a world-renowned science and engineering institute that marshals some of the world's brightest minds and most innovative tools to address fundamental scientific questions. We thrive on finding and cultivating talented people who are passionate about what they do. Join us and be a part of the diverse Caltech community.
The Caltech Center for Teaching, Learning, and Outreach (CTLO) supports the Institute’s multifaceted educational efforts, including both university-level teaching and educational programs for K-12 students and teachers. The Assessment and Evaluation Specialist (AES) is a half-time position that will focus on K-12 programs, with the possibility of additional hours on small-scale projects that focus on university-level educational assessment.
The AES will be responsible for completing both formative assessment and summative evaluation of selected CTLO STEM educational outreach initiatives. The AES will work with CTLO staff, faculty, students, school administrators, and teachers to plan and conduct all aspects of studies, including developing or adapting assessment instruments, obtaining institutional review board (IRB) approval and informed consent, and collecting and analyzing data. Special attention will be paid to measuring outcomes not only for the K-12 teachers and students participating in programs, but for the Caltech students and researchers involved in planning and implementing these programs. The AES will present results in report formats to members of the CTLO team and other institutional representatives. The AES will also provide guidance in developing assessment instruments, evaluation procedures, and data analysis procedures that can be used by CTLO in the future. The AES will contribute to writing grant reports and incorporating findings into funding proposals.
- Plan, design, and conduct assessment of intended outcomes (e.g., learning outcomes, affective outcomes, behavioral outcomes) for K-12 students and teachers, as well as for Caltech students and researchers involved in delivering programs.
- Conduct holistic evaluation of STEM outreach projects and initiatives.
- Design survey instruments to use in assessing outreach projects and initiatives.
- Collect data through various means such as classroom observations, survey instruments, and student assessments.
- Manage informed consent and required IRB permissions.
- Analyze data collected and develop reports, including program improvement recommendations.
- Provide leadership regarding effective models, methods, and systems for evaluation and assessment of outreach programs.
- Attend and/or present at internal meetings as assigned or requested.
- Collaborate on funder reports and proposal development.
- Perform related work as required.
- Master's degree in education, STEM education, educational measurement, assessment and evaluation, or similar field.
- Successful experience in assessment and evaluation of education programs and initiatives.
- Experience in qualitative and quantitative educational data collection and analysis; data management and analysis; measurement theories; and survey design, development, validity, and reliability.
- Prior training and certification in human subjects research, with a focus in social/behavioral/educational research (e.g., through CITI or other known provider).
- Thorough knowledge of the principles, practices, and procedures of educational assessment and program evaluation practices.
- Ability to communicate ideas clearly and concisely, orally and in writing, including strong report writing skills.
- Ability to establish and maintain effective relationships with staff and administration.
- Strong project management skills.
- Knowledge of current K-12 STEM education issues.
- Must possess or have the ability to obtain a valid California Driver’s License and maintain it throughout the course of employment.
- 5 years successful experience in STEM education program assessment and evaluation.
- Successful experience as an independent evaluator of STEM education programs or projects.
- Membership or leadership in professional organizations or associations.
- Exemplary writing evidenced by published reports or articles in professional journals.
- Cover Letter