Rigorous evidence of program effectiveness has become increasingly important with the 2015 passage of the Every Student Succeeds Act (ESSA). One question that has not yet been fully explored is whether program evaluations carried out or commissioned by developers produce larger effect sizes than evaluations conducted by independent third parties.…

This response aims to critically evaluate the methodology and aims of the meta-analytic review written by Maggin and Johnson (2014). The present authors systematically provide responses for each of the original criticisms and highlight concerns regarding Maggin and Johnson's methodology, while objectively describing the current state of evidence…

This article addresses the problem of making programme evaluation sufficiently meaningful and cognisant of context such that practitioners, in this case of academic development, can gain new understandings of their situation in order to improve their practice. In order to do this, the paper uses Archer's morphogenetic framework to deepen the…

Calls for universal preschool programs have become commonplace, reinforced by President Obama's call for "high-quality preschool for all" in 2013. Any program that could cost state and federal taxpayers $50 billion per year warrants a closer look at the evidence on its effectiveness. This report reviews the major evaluations of preschool…

This study explores the extent to which differences in research design explain variation in Head Start program impacts. We employ meta-analytic techniques to predict effect sizes for cognitive and achievement outcomes as a function of the type and rigor of research design, quality and type of outcome measure, activity level of control group, and…

This meta-analysis synthesized bullying prevention programs' effectiveness at increasing bystander intervention in bullying situations. Evidence from 12 school-based programs, involving 12,874 students, indicated that overall the programs were successful (Hedges's g = 0.20, 95% confidence interval [CI] = 0.11 to 0.29, p = 0.001), with larger…

Recent interest in studying social aspects of leadership has brought attention to the relationship between leadership and social capital. There is also growing interest among stakeholders (researchers, practitioners, funders, and program participants) to improve evaluation methods for leadership development programs (LDPs). The purpose of the…

In January 2011, a Joint Committee of representatives from the U.S. Department of Education (ED) and the U.S. National Science Foundation (NSF) began work to establish cross-agency guidelines for improving the quality, coherence, and pace of knowledge development in science, technology, engineering and mathematics (STEM) education. Although the…

In response to rising rates of firearms violence that peaked in the mid-1990s, a wide range of policy interventions have been developed in an attempt to reduce violent crimes committed with firearms. Although some of these approaches appear to be effective at reducing gun violence, methodological variations make comparing effects across program…

Over 20 years ago, Robert J. Barak and Barbara E. Breier suggested incorporating a regular assessment of the entire program review system into the review schedule in order to ensure that the system itself is as efficient and effective as the programs under review. Barak and Breier's seminal book on the goals and processes of program review has…

This review examines the effectiveness of educational technology applications in improving the reading achievement of struggling readers in elementary schools. The review applies consistent inclusion standards to focus on studies that met high methodological standards. A total of 20 studies based on about 7,000 students in grades K-6 were included…

It has become accepted wisdom that there is a shortage of leaders in the library profession. A number of leader and leadership development programs have emerged in Australia, Canada and the United States that attract interested participants, yet what is the core purpose of these programs? Do they work? Review of leadership programs reveals that…

The Centers for Disease Control and Prevention (CDC) is currently conducting research and analyses to guide practitioners in making evidence-based program decisions. A meta-analysis of the current research literature on training programs for parents with children ages 0 to 7 years old was recently conducted by CDC behavioral scientists. This…

This review examines the effectiveness of educational technology applications in improving the reading achievement of struggling readers in elementary schools. The review applies consistent inclusion standards to focus on studies that met high methodological standards. A total of 20 studies based on about 7,000 students in grades K-6 were included…

The main objective of this systematic review and meta-analysis was to examine the effects of intervention programs on school attendance behaviors of elementary and secondary school students to inform policy and practice. The specific questions guiding this study were: (1) Do indicated programs with a goal of increasing student attendance affect…