In response to Eleanor Chelimsky's inspiring plenary address 3 years ago, and with generous support from the Robert Wood Johnson Foundation, the Eastern Evaluation Research Society launched the Eleanor Chelimsky Forum at its 2013 Annual Conference. The objective of this annual Forum, which has become a hallmark event in the evaluation world, is to…

Despite the increase in federal tiered evidence initiatives that require the use of rigorous evaluation designs, such as randomized experiments, there has been limited guidance in the evaluation literature on practical strategies to implement such studies successfully. This paper provides lessons learned in executing experiments in applied…

The relationship between theory and practice, or between theoretical knowledge and practical knowledge, is not a simple one, and rarely is it the case that theory is "applied" to practice. This paper aims to clarify the relationship by briefly discussing the nature of practical problems and the role that theoretical knowledge plays in…

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

This article describes the development and use of a rapid evaluation approach to meet program accountability and learning requirements in a research for development program operating in five developing countries. The method identifies clusters of outcomes, both expected and unexpected, happening within areas of change. In a workshop, change agents…

Several analytic strategies exist for opening up the "black box" to reveal more about what drives policy and program impacts. This article focuses on one of these strategies: the Analysis of Symmetrically-Predicted Endogenous Subgroups (ASPES). ASPES uses exogenous baseline data to identify endogenously-defined subgroups, keeping the…

William Dean Crano is the Stuart Oskamp Distinguished Professor of Psychology in the School of Behavioral and Organizational Sciences at Claremont Graduate University. A social psychologist, Crano received his MS and PhD degrees from Northwestern University, where Donald T. Campbell was his advisor and mentor. Dr. Crano has served on the faculties…

Over the past 14 years, AEA's Oral History Project Team (Robin Lin Miller, Jean A. King, Valerie Caracelli, and Melvin M. Mark) has conducted interviews with individuals who have made signal contributions to evaluation theory and practice, tracing their professional development and contextualizing their work within the social and political…

Professional learning communities (PLCs) have emerged as one of the nation's most widely implemented strategies for improving instruction and PK-12 student learning outcomes. PLCs are predicated on the principles of improvement science, a type of evidenced-based collective inquiry that aims to bridge the research-practice divide and increase…

The evaluation theory tree typology reflects the following three components of evaluation practice: (a) methods, (b) use, and (c) valuing. The purpose of this study was to explore how evaluation practice is conceived as reflected in articles published in the "American Journal of Evaluation" ("AJE") and "Evaluation," a…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

The evaluation community has demonstrated an increased emphasis and interest in evaluation capacity building in recent years. A need currently exists to better understand how to measure evaluation capacity and its potential outcomes. In this study, we distributed an online questionnaire to managers and evaluation points of contact working in…

Interest in the regression discontinuity (RD) design as an alternative to randomized control trials (RCTs) has grown in recent years. There is little practical guidance, however, on conditions that would lead to a successful RD evaluation or the utility of studies with underpowered RD designs. This article describes the use of RD design to…

We examined the extent to which mathematics program evaluations that have been conducted according to methodologically rigorous standards have attended to the theories underlying the programs being evaluated. Our analysis focused on the 37 reports of K-12 mathematics program evaluations in the last two decades that have met standards for inclusion…

Programs for domestic violence (DV) victims and their families have grown exponentially over the last four decades. The evidence demonstrating the extent of their effectiveness, however, often has been criticized as stemming from studies lacking scientific rigor. A core reason for this critique is the widespread belief that credible evidence can…