Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

The act of valuing in an evaluation may be perceived in different ways. We consider the multiple theoretic perspectives that govern an evaluator's behavior and present a typology of evaluator valuing roles. Within this typology we describe three ways in which value judgments are typically reached--by stakeholders alone, stakeholders and evaluators…

In contrast to typical National Science Foundation program evaluations, the Utah State Math Science Partnership-Research, Evaluation and Technical Assistance Project (MSP-RETA) provided technical assistance (TA) in two forms: direct TA for up to 10 projects a year, and professional development sessions for a larger number of project staff. Not…

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

With the vast array of contextual factors, pedagogical approaches, models of implementation, and purposes of education and training related to online learning, educators, learners, and the general public alike are seeking answers regarding utility and effectiveness of online learning. This article identifies and responds to many of the challenges…

A team at the University of Minnesota conducted the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation between 1999 and 2004. The purpose of the CETP core evaluation was to achieve consensus among CETP project leaders and project evaluators on evaluation questions; to develop, pilot, and field test evaluation instruments…

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

Programs and policies invariably contain new knowledge. Theories about knowledge utilization, diffusion, implementation, transfer, and knowledge translation theories illuminate some mechanisms of change processes. But more often than not, when it comes to understanding patterns about change processes, "the foreground" is privileged more…

Case studies about managing evaluation are examined for perspectives on expertise in managing evaluation. There are lessons on a geography of managing, managing as organizational work, the notions of "competency" and "expertise," and managing evaluation as professional work. Dreyfus and Dreyfus (2004) offer a framework for an introductory…

Historically, examples of project evaluation in conservation were rare. In recent years, however, conservation professionals have begun to recognize the importance of evaluation both for accountability and for improving project interventions. Even with this growing interest in evaluation, the conservation community has paid little attention to…

Depth, resonance, and shadow are added to how the expertise of managing evaluation could be grasped and understood. Returning to the notion of "competency" (Stevahn, King, Ghere, & Minnema, 2005), this is contrasted more deeply with Dreyfus and Dreyfus's (2004) conception of expert and to its use in nursing by Benner (2004; Benner, Tanner, &…

This chapter describes the author's experience and insights as the chief of evaluation for public diplomacy at the U.S. Department of State, and as a consultant assisting federal agencies in a multitude of evaluation activities relating what helps and hinders internal evaluation functions. The article discusses the challenges faced by the internal…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…