Social justice--oriented evaluation approaches are described as participatory, culturally and contextually responsive, and self-empowering. These evaluation approaches call for the genuine participation of stakeholders for sound evaluations, particularly those outside of decision-making and service providing. Similarly, hip-hop is commonly…

Deforestation is an environmental stressor that dramatically threatens biodiversity while having adverse, deep-rooted, socioeconomic impacts. Interventions to address deforestation require considerable long-term investments; therefore, assessing their impact is crucial. The UN Convention on Biological Diversity encourages establishing protected…

Intervention scientists have used program theory-driven evaluation to design, implement, and assess the success of intervention programs for decades. However, interventions often are designed without the input of the community for which they are intended. The lack of incorporation of community members' voices that participate in various…

In an era of ever-deepening budget cuts and a concomitant demand for substantiated programs, many organizations have elected to conduct internal program evaluations. Internal evaluations offer advantages (e.g., enhanced evaluator program knowledge and ease of data collection) but may confront important challenges, including credibility threats,…

Drawing on the extensive ethnographic research I conducted on Italy's performance evaluation system, this article highlights the cognitive biases associated with evidence use in decision making and institution working. Framing effects, status quo bias, motivated reasoning, and tacit conflicts between personal and organizational interests were only…

The integrated nature of the Sustainable Development Goals (SDGs) calls for greater synergy, harmonization, and complementarity in development work. This is to be reflected in evaluation. Despite a long and diversified history spanning over almost three decades, joint evaluations have fallen out of fashion. Evaluators tend to shy away from joint…

"Lesson study" has garnered considerable attention from educational researchers and practitioners as a promising method for improving instruction. At its core, lesson study reflects a collaborative inquiry process, grounded in cycles of planning, enacting, and reflecting, that promotes teacher learning through active engagement in lesson…

Evaluation is defined by its central task of valuing--the process and product of judging the merit, worth, or significance of a policy or program. However, there are no clear-cut ways to consider values and render value judgments in evaluation practice. There remains contention in the evaluation field about whether and how to make value judgments.…

Qualitative comparative analysis (QCA) is gaining ground in evaluation circles, but the number of applications is still limited. In this article, we consider the challenges that can emerge during a QCA evaluation by drawing on our experience of conducting one in the field of development cooperation. For each stage of the evaluation process, we…

Evaluators often find themselves in situations where resources to conduct thorough evaluations are limited. In this paper, we present a familiar instance where there is an overwhelming amount of open text to be analyzed under the constraints of time and personnel. In instances when timely feedback is important, the data are plentiful, and answers…

We assessed whether an adaptation of value-added analysis (VAA) can provide evidence on the relative effectiveness of interventions implemented in a large school district. We analyzed two datasets, one documenting interventions received by underperforming students, and one documenting interventions received by students in schools benefiting from…

Efforts to promote professionalism in evaluation, whether through certification, credentialing, or other path, are not new, but there is a new push to adopt sets of essential evaluator competencies, both in the United States and globally, that are intended to advance professionalism of the field. This emphasis on professionalism is relevant to the…

George Grob presented the fifth and final Eleanor Chelimsky Forum address at the 2017 annual meeting of the Eastern Evaluation Research Society. In this commentary, I respond to several points that George raises in the "American Journal of Evaluation" paper based on that address. An overarching theme of my comments involves the potential…

A randomized experiment that measures the impact of a social policy in a sample of the population reveals whether the policy will work on average with universal application. An experiment that includes only the subset of the population that volunteers for the intervention generates narrower "proof-of-concept" evidence of whether the…

The ethical guidelines for the American Evaluation Association and the principles of community-based participatory evaluation both state the importance of equitable stakeholder involvement. Regardless of the evaluation approach, however, evaluators are often confronted with gatekeepers, or those who control the access to stakeholders, information,…