In this article, we reflect on our experience applying a framework for evaluating systems change to an evaluation of a statewide West Virginia alliance funded by the National Science Foundation (NSF) to improve the early persistence of rural, first-generation, and other underrepresented minority science, technology, engineering, and mathematics…

Organizational evaluation policies describe how evaluation practices should be structured and implemented. As such, they provide key insights into organizational priorities and values regarding evaluation. However, the link between evaluation policies and how evaluation policies translate into concrete practices has seldom been explored until now.…

2015 was designated the International Year of Evaluation, suggesting that evaluation has an important role to play in service of positive global ideals. It is vital to recognize the critical role that the education of evaluators plays in these efforts. The current study uses an online search and curricular analysis to provide a snapshot of…

As global discussions of evaluation standards become more contextually nuanced, culturally responsive conceptions of ethics have not been sufficiently discussed. In academic social research, ethical clearance processes have been designed to protect vulnerable people from harm related to participation in a research project. This article expands the…

Evaluators are becoming increasingly aware that, to provide maximum benefit to the programs they evaluate, they must address the systems within which the programs work. However, evaluation practice is often influenced by beliefs and assumptions that are rooted in an understanding of these systems as stable and predictable. We identify four traps…

Free-listing is a quick, semi-quantitative methodology commonly used by anthropologists to uncover information within a cultural domain. In this method note, we review how anthropologists have used free-listing in a variety of research settings. We then apply the social-ecological framework to describe how free-listing can be used for formative,…

Sustainable community health improvement often requires the implementation of complex interventions in complex systems. Drawing from the "Four Keys to Success" frame (theory, implementation, support, and evaluation), this article describes how we used a formative evaluation approach to foster a learning system capable of monitoring and…

Evaluation scholars have committed decades of work to the development of evaluator competencies. The 2018 American Evaluation Association (AEA) Evaluator Competencies may be useful for evaluators to identify their strengths and weaknesses to improve their practice; however, a few empirically validated self-assessment tools based on the…

The merit of narrative film methods to support participatory approaches and professional development has been increasingly demonstrated by research in several fields and education. However, the use of digital storytelling and other film methods in evaluation remains largely unchartered territory. This article provides a case study of a digital…

Many organizations now have evaluation policies. Because formal evaluation policies intend to frame evaluation practice, it is important to understand the aims of policies and their influence on practice. Evaluation theory is also intended to guide practice; therefore, the extent to which policies are informed by theory is also important to…

This paper unpacks our efforts as external evaluators to work toward decolonizing our evaluation practice. Undertaking this writing exercise as a form of reflective practice demonstrated that decolonization is much more complex than simply translating materials, organizing locals to collect data, and building participants' capacity around Western…

Complexity and uncertainty are long-standing challenges for global development projects. Coping with both requires flexibility and adaptation, the ability to identify unexpected circumstances, seize opportunities, and respond to threats. Vigilance is critical; it resides within the domains of monitoring, evaluation, and learning. In practice,…

This article problematizes methodological practices, specifically the use of surveys as tools of measurement in evaluation with migrant youth. Drawing from Foucault's "Genealogy of Ethics," we investigate the knowledge created about particular minoritized groups through the author's current evaluation, the power relations involved, and…

Most Americans consume diets at odds with nutrition recommendations, contributing to our ongoing epidemics of noncommunicable diseases. One strategy for accelerating progress toward healthier diets involves formal agreements between companies and nongovernmental organizations to develop new products, reformulate existing products, and implement…

Based on interviews and case studies in nonprofit organizations, this article examines the perspectives of evaluation advocates undertaking evaluation in culturally diverse contexts where interpersonal barriers may exist. Participants provided insights into how to overcome issues by developing meaningful interpersonal relationships, finding shared…