Director of Evaluation
Job Code: 4749
Job Grade: L
Exemption Status: Exempt, Full-Time, Continuing
Heralded as a hub of undergraduate innovation, the Office of the Vice Provost for Undergraduate Education (VPUE) creates and sustains meaningful interactions between students and faculty both within and outside the classroom. As a team member of VPUE, you have a unique opportunity to advance and support programs that touch and enhance the lives of every undergraduate student at Stanford.
The Vice Provost’s Office (VPO) within VPUE supports the operations of the overall VPUE organization, oversees a set of programs, grants, and pilots, and collaborates with faculty, departments, schools and other campus partners to advance undergraduate education across the university.
VPUE is seeking a Director of Evaluation to oversee assessment and program evaluation efforts that will drive program improvement and inform decision-making about undergraduate education by program, unit, division, and university leadership. The director is responsible for VPUE program evaluations, working in close collaboration with faculty and staff during all phases of the research life cycle, including study design, implementation, analysis, and reporting. In addition, the director will design and implement assessment projects to answer broader questions about the undergraduate experience, presenting data and findings that will shape decisions about overall priorities and direction for undergraduate education, often working in collaboration with other offices such as Institutional Research & Decision Support (IR&DS) or the Office of the Vice Provost for Teaching and Learning (VPTL). The director acts as an internal consultant on evaluation best practices, including how to articulate goals and key questions, choose appropriate methodology, and accurately interpret and apply evidence. The director also serves as the VPUE expert on the division’s research and data usage policy, collaborating with stakeholders to define and interpret policy and advise VPUE leadership on its application. This position supervises the assessment and program evaluation analyst.
Your responsibilities will include:
- Design, conduct, and coordinate program evaluations.
- Consult with and coach staff and faculty designing new programs or pilots in articulating goals and determining appropriate metrics to evaluate progress toward these goals; provide guidance on embedding assessment measures into program design and structures to produce compelling evidence.
- In collaboration with VPUE leadership and partners on campus, design and conduct studies to inform understanding of the undergraduate experience, and interpret findings from studies to help leaders make sense of patterns and trends and answer questions raised by leadership.
- Incorporate knowledge and best practices from the research literature and peer institutions when formulating key questions and study design, in order to enhance the accuracy and applicability of localized findings.
- Develop, interpret, and apply policy regarding research on students and other assessment and evaluation practices in VPUE; consult with stakeholders (including IR&DS), and advise VPUE senior leadership on decisions about which projects to approve.
- Select the issues/challenges having the most value to the organization and determine methodology to utilize in interpreting and gathering data from multiple sources on the issue.
- Drive collection of new data and the refinement of existing data sources; apply and use algorithms or other advanced techniques to accomplish this. Recommend ways to apply the data. Assures reliable and consistent data is maintained and available for both ad hoc and longitudinal inquiries
- Fully analyze the problem, question existing processes and assumptions, gather data and information, find and evaluate alternative solutions, and propose best course of action.
- Explore data from multiple angles, determine meaning behind the data, and recommend ways to apply the data.
- Communicate, convey, and visualize informed conclusions and recommendations across an organization’s leadership structure in a manner to “tell the story” behind the data and influence how organization approaches the challenge.
- Interact with and influence senior leaders, faculty, and/or senate with written summaries and/or presentations.
- Communicate data requirements to VPUE and university IT groups; collaborate with these groups to ensure that necessary data assets are available; consider and communicate how university data resources such as SIRIS can structure data/reports to better serve VPUE stakeholders.
- Collaborate with other organizations to gather data. Proactively seek and locate data, including outside benchmarks or comparative data, to support or refute proposed decisions.
- Supervise other information analytics staff and direct on project work.
To be successful in this position you will have:
- Bachelor’s degree and seven years of extensive, relevant experience or combination of education and relevant technical field experience solving analytical problems using quantitative and qualitative approaches.
- Facility in analyzing and manipulating data from multiple and varying sources.
- Extensive experience in and strong passion for empirical research and answering hard questions with data.
- Interpersonal and communication skills to effectively convey findings and broad trends to a variety of audiences and positively influence senior leadership & faculty.
- Ability to use data retrieval and manipulation tools such as SQL and business intelligence applications along with visual data tools to present data clearly to non-technical audiences.
- Advanced proficiency with statistical tools such as SPSS, Stata, R or similar tools.
- Ability to tell stories with data using data visualization software such as Tableau, Excel, Stata, or similar software in conjunction with strong verbal ability.
- Ability to use visual data tools to clearly articulate data to non-technical audiences.
- Flexible analytical approach crafting multiple options with supporting arguments for the same goal and allowing for results at varying levels of precision.
- Facilitation skills to conduct meetings to achieve the desired outcome and manage projects within time constraints.
- In depth knowledge of University administrative organization, policies, procedures, and practices for institutional research-oriented roles.
*-Consistent with its obligations under the law, the University will provide reasonable accommodation to any employee with a disability who requires accommodation to perform the essential functions of his or her job.
In addition, preferred requirements include:
- Advanced degree (Ph.D. in social sciences, education, assessment)
- Experience with program evaluation, preferably in higher education or non-profit environment.
- 2 years in administrative experience and/or program management experience, especially with complex projects with multiple deadlines
- Ability to listen effectively, to provide tactful feedback and support, and to use sound judgement when dealing with sensitive, controversial and / or confidential matters.
- Demonstrated experience in assisting faculty and staff to articulate program goals and determine most effective approaches and tools to evaluate progress toward these goals.
- Demonstrated experience and ability to work collaboratively and constructively with people at multiple levels and in diverse roles (faculty, staff, lecturers, postdocs, graduate students, undergraduates) and with diverse perspectives.
- Ability to adopt an objective, professional, and research-minded perspective when designing evaluations, conveying findings, and interacting with diverse stakeholders.
- Knowledge of the scholarly literature on higher education administration, college student development, and/or teaching and learning at the university level.
- Interpersonal and communication skills to effectively convey findings and broad trends to a variety of audiences and positively influence senior leadership and faculty.
- Ability to operate effectively in ambiguous, unstructured environments and to propose new courses of action and/or evaluation approaches in the absence of pre-existing templates or guidelines.
About the Office of the Vice Provost for Undergraduate Education (VPUE)
For undergraduates, VPUE is the nexus for programs and initiatives that help students define and achieve their intellectual ambitions at Stanford. These include investigative introductory courses taught by esteemed faculty, targeted classes in writing and rhetoric, undergraduate research support, academic advising and mentoring, overseas and off-campus study programs, and undergraduate scholarships and fellowships. For faculty, VPUE serves as a principal conduit for furthering interaction with undergraduates and discovering ways in which working with students can enrich one’s research agenda. VPUE advocates for undergraduate education in collaboration with faculty, departments and schools across Stanford. All VPUE resources are dedicated to involving faculty with the undergraduate experience, connecting students with phenomenal opportunities and fully realizing a liberal education at Stanford.
Why Stanford is for You
Imagine a world without search engines or social platforms. Consider lives saved through first-ever organ transplants and research to cure illnesses. Stanford University has revolutionized the way we live and enrich the world. Supporting this mission is our diverse and dedicated 17,000 staff. We seek talent driven individuals to impact the future of our legacy. Our culture and unique perks empower you with:
- Freedom to grow. We offer career development programs, tuition reimbursement, or course auditing opportunities. Join a TedTalk, film screening, or listen to a renowned author or global leader speak.
- A caring culture. We provide superb retirement plans, generous time-off, and family care resources.
- A healthier you. Climb our rock wall, or choose from hundreds of health or fitness classes at our world-class exercise facilities. We also provide excellent health care benefits.
- Discovery and fun. Stroll through historic sculptures, trails, and museums.
- Enviable resources. Enjoy free commuter programs, ridesharing incentives, discounts and more!
How to Apply
If you’re ready to work for an organization that nurtures diversity, respect, professional development and a comfortable work-life fit, we invite you to explore this opportunity and apply online. To be considered, please submit a cover letter and resume along with your online application. Your one-page cover letter should briefly describe your background and experience in program evaluation and assessment.
- Click on Job Search
- Enter 84048 in the Keyword Search field
- Schedule: Full-time
- Job Code: 4749
- Employee Status: Regular
- Grade: L