One of the biggest challenges that states and local intermediaries face in setting up and scaling high-quality youth apprenticeships is gathering relevant, accurate and actionable data. High-quality data is an essential ingredient for a strong youth apprenticeship program because it equips state and local leaders to evaluate impact, monitor…

Evaluators widely agree that stakeholder involvement is a central aspect of effective program evaluation. With the exception of articles on collaborative evaluation approaches, however, a systematic review of the breadth and depth of the literature on stakeholder involvement has not been published. In this study, we examine peer-reviewed empirical…

The rapidly growing number of learning materials and repositories makes the issue of how to find the most relevant and best quality resources to be integrated in teaching and learning offers. Thus, effective quality assessment tools are more and more needed. In the present paper, a case-study focusing on quality assurance in a Virtual Mobility…

This paper focuses on our experience of researching the influence of ResourceSmart Schools, a sustainable schools programme in Victoria, Australia. Drawing on ideas from programme theory and realist synthesis, we illustrate and reflect upon our approach to conceptualising, investigating and generating evidence about the programme's…

This chapter proposes approaches for assessing learners and evaluating courses and curriculum that could be used by directors of health professions education (HPE) programs to determine the effectiveness and impact of their programs.

This paper explores the dynamics of a research partnership between a practicing clinician/research and 34 West Virginia high school students participating in a precollege STEM intervention program. The collaboration provided a more diverse study sample to the clinician for examining attitudes about knee osteoarthritis in adults over 40. It…

Effectively measuring short-term impact, particularly a change in knowledge resulting from Extension programming, can prove to be challenging. Clicker-based technology, when used properly, is one alternative that may allow educators to better evaluate this aspect of the logic model. While the potential interface between clicker technology and…

Despite bipartisan support in Washington, DC, which dates back to the mid-1990s, the "what works" approach has yet to gain broad support among policymakers and practitioners. One way to build such support is to increase the usefulness of program impact evaluations for these groups. We describe three ways to make impact evaluations more…

Background/Context: Teacher preparation programs (TPPs) face increasing pressure from the federal government, states, and accreditation agencies to improve the quality of their practices and graduates, yet they often do not possess enough data to make evidence-based reforms. Purpose/Objective: This manuscript has four objectives: (a) to present…

People providing services to schools, teachers, and students want to know whether these services are effective. With that knowledge, a project director can expand services that work well and adjust implementation of activities that are not working as expected. When finding that an innovative strategy benefits students, a project director might…

The Big Lift is a collective impact initiative extending from preschool to third grade in San Mateo County, California. The collective impact effort consists of people and organizations from various sectors uniting to tackle a single, complicated societal problem -- in this case, third grade reading achievement. The initiative is a partnership of…

The "Integrated Approaches to Supporting Child Development and Improving Family Economic Security" project was conducted by Mathematica Policy Research and Northwestern University for the Office of Planning, Research and Evaluation (OPRE), in the Administration for Children and Families (ACF) at the U.S. Department of Health and Human…

This article describes an innovative evaluation plan we employed to capture outcomes of a multiyear beginning farmer program and, specifically, highlights the facilitation technique we used to document short-term and intermediate goals of the program that matched U.S. Department of Agriculture grant requirements and Extension administration…

New Extension educators experience a steep learning curve when attempting to develop effective Extension programs. Formative evaluation is helpful to new, and experienced, Extension educators in determining the changes necessary for making programs more effective. Formative evaluation is an essential part of program evaluation. However, its use…

Students learn best when they are in environments in which they feel safe, supported, challenged, and accepted. In addition, environments that have strong school climates foster the social, emotional, and academic well-being of all students. Research shows that when schools and districts effectively focus on improving school climate, students are…