While evaluation capacity building (ECB) may hold promise for fostering evaluation, little is known about how it is operationalized within a network. This article presents initial findings from a National Science Foundation-funded research project (Complex Adaptive Systems as a Model for Network Evaluations) that used concepts from complex…

Site visits are used extensively in a variety of settings within the evaluation community. They are especially common in making summative value decisions about the quality and worth of research programs/centers. However, there has been little empirical research and guidance about how to appropriately conduct evaluative site visits of research…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

A team at the University of Minnesota conducted the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation between 1999 and 2004. The purpose of the CETP core evaluation was to achieve consensus among CETP project leaders and project evaluators on evaluation questions; to develop, pilot, and field test evaluation instruments…

Meta-evaluations reported in the literature, although rare, often have focused on retrospective assessment of completed evaluations. Conducting a meta-evaluation concurrently with the evaluation modifies this approach. This method provides the opportunity for the meta-evaluators to advise the evaluators and provides the basis for a summative…

As the number of large federal programs increases, so, too, does the need for a more complete understanding of how to conduct evaluations of such complex programs. The research literature has documented the benefits of stakeholder participation in smaller-scale program evaluations. However, given the scope and diversity of projects in multi-site…

The purpose of this article is to describe evaluation capacity building using an immersion approach in two schools: one with an administrator-led process and one with a teacher-led process. The descriptions delineate conceptual, developmental, and sustainability aspects of capacity building through the perspectives of the teachers, principals, and…

The purpose of this article is to describe a new collaborative immersion approach for developing evaluation capacity that was used in kindergarten through Grade 12 (K-12) schools and to place this new approach on a continuum of existing capacity-building methods. The continuum extends from individualistic training-oriented methods to collaborative…

Use of evaluation findings is a valued outcome for most evaluators. However, to optimize use, the findings need to be disseminated to potential users in formats that facilitate use of the information. This reflective case narrative uses a national evaluation of a multisite National Science Foundation (NSF) program as the setting for describing the…

In this article, the authors examine evaluation process use in a large multilevel, multisite core evaluation. This case highlights the nature of the evaluation processes of the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation in terms of four categories: (1) social processing; (2) engagement; (3) involvement; and (4)…

Nationally, there is continuing debate about appropriate methods for conducting educational evaluations. The U.S. Department of Education has placed a priority on "scientifically" based evaluation methods and has advocated a "gold standard" of randomized controlled experimentation. The priority suggests that randomized control methods are best,…

This article presents a brief history of the National Science Foundation's involvement in education evaluation, reviews the program evaluations that NSF's Division of Research, Evaluation, and Communication (REC) has conducted in recent years, and describes future directions. The evaluations have reflected the field-driven nature of NSF's…

Building the evaluation capacity of K-12 schools is clearly an important goal for the field of evaluation, especially in the current educational environment, which is dominated by issues of accountability and high-stakes testing. The focus on student achievement has forced schools to become more data-driven as they attempt to analyze test scores…