Performance-based accountability along with budget tightening has increased pressure on publicly funded organizations to develop and deliver programs that produce meaningful social benefits. As a result, there is increasing need to undertake formative evaluations that estimate preliminary program outcomes and identify promising program components…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…

The discussion on and development of a holistic evaluation approach for rural development will be indispensable to improving and enriching the lives of rural people. This approach can be developed by considering the conceptualization of community policy structure in rural areas, the localization of policy structure in the rural community, and the…

Researchers and policy makers are increasingly dissatisfied with the "average treatment effect." Not only are they interested in learning about the overall causal effects of policy interventions, but they want to know what specifically it is about the intervention that is responsible for any observed effects. In the U.S., using…

This study addresses the central question "How do evaluators' background characteristics relate to their evaluation design choices?" Evaluators were provided with a fictitious description of a school-based program and asked to design an evaluation of that program. Relevant background characteristics such as level of experience,…

This study addresses validity issues in evaluation that stem from Ernest R. House's book, "Evaluating With Validity". The authors examine "American Journal of Evaluation" articles from 1980 to 2010 that report the results of policy and program evaluations. The authors classify these evaluations according to House's "major approaches" typology…

Although the general conceptual basis appeared far earlier, theory-driven evaluation came to prominence only a few decades ago with the appearance of Chen's 1990 book "Theory-Driven Evaluations." Since that time, the approach has attracted many supporters as well as detractors. In this paper, 45 cases of theory-driven evaluations, published over a…

In developing countries, an increasing number of civil society organizations (CSOs) engage in independent monitoring and evaluation (M&E) of government programs and policies. Most CSOs rely on a range of M&E tools in combination with advocacy strategies to hold government accountable and improve the implementation of programs and policies.…

Shadowing is a data collection method that involves following a person, as they carry out those everyday activities relevant to a research study. This article explores the use of shadowing in a formative evaluation of a professional development school (PDS). Specifically, this article discusses how shadowing was used to understand the role of a…

Although evaluation theorists over the last two decades have argued for the importance of including stakeholders from marginalized groups in program planning and research, little is known about the degree of inclusion in program evaluation practice. In particular, we know little about the type and level of inclusion of people with intellectual,…

In 1997, American Evaluation Association member George Grob, now retired from the U.S. Department of Health and Human Services (HHS) and currently President of the Center for Public Program Evaluation, made a testimony on Medicare home health care fraud and abuse before the U.S. Senate Special Committee on Aging. The occasion was to announce the…

The author enjoyed reading Katharine Hay's ambitious and humbling visions for evaluation field building in South Asia. She has successfully positioned herself on a high mountain with a wonderful set of binoculars that enable her to see the entire evaluation landscape of South Asia. She magically sees and describes significant historical forces and…

Prior evaluations of evaluation theory have been problematic due in part to confusion about what exactly is being assessed. After drawing distinctions among evaluation theories, models, and approaches, the author examines three aspects of evaluation models and considers how the evaluation of a model depends on which aspect is being examined. The…

This contribution to the Ethics section is intended to foster discussion about the relationship between multicultural competence and ethics; a timely discussion especially in view of the release in 2011 of the American Evaluation Association's Public Statement on Cultural Competence (http://www.eval.org/ccstatement.asp). Over the course of 2011,…

The papers in this dialogue help develop evaluation as a field (both in South Asia and other regions). What comes through in all of the papers is both humility of where evaluation is as a field and imagination and ambition of where evaluators could be in the near future. Reading the papers in this forum makes them enthusiastic about being…