Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

Research synthesis of evaluation findings is a multistep process. An investigator identifies a research question, acquires the relevant literature, codes findings from that literature, and analyzes the coded data to estimate the average treatment effect and its distribution in a population of interest. The process of estimating the average…

Today, nearly forty years after writing centers first began to proliferate, it is worthwhile to reflect on the themes that emerge from empirical material surrounding writing center assessments, for reflecting on these themes may help administrators to refine current assessment practices and scholars to redirect their research. The goal of this…

In this paper, the author considers certain aspects of the problem of obtaining unbiased information about the merits of a program or product, whether for purposes of decision making or for accountability. The evaluation of personnel, as well as the evaluation of proposals and evaluations, generally involves a different set of problems than those…

The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

In recent years, procedures have been established in Flanders for "Prior Learning Assessment" (PLA) outside the formal learning circuit, of which the portfolio is a regular component. In order to maximize the possibilities of acknowledgement of prior learning assessment, the Flemish government is looking for a set of common criteria and…

The last major review of the achievement outcomes of comprehensive school reform (CSR) models was conducted in 2003. Despite the growing evidence base supporting CSR, the program was discontinued by the federal government in 2007. Now, six years after the 2003 meta-analysis, the study's lead author, Geoffrey Borman, revisits the results and…

The authors review research literature on coherent theoretically based approaches to the use of reflective processes within programmes of initial professional education for new academic staff. Employing a novel methodology that incorporates practitioner perspectives, they establish a framework that highlights the role of personal and social…

The authors examined the methodologies of articles in teaching-and-learning research journals, published in 1994 and in 2004, and classified them as either intervention (based on researcher-manipulated variables) or nonintervention. Consistent with the findings of Hsieh et al., intervention research articles declined from 45% in 1994 to 33% in…

Purpose: This study assessed the psychometric properties of instruments used to measure constructs similar to stuttering-specific health-related quality of life. In the stuttering literature, most such instruments were originally intended to measure speakers' attitudes about, or reactions to, their stuttering. Method: Seventeen instruments were…

This is a critical review of methodological issues in the evaluation of adult literacy education programs in the United States. It addresses the key research questions: What are the appropriate methods for evaluating these programs under given circumstances. It identifies 15 evaluation studies that are representative of a range of adult literacy…

Impact evaluations of school-based management (SBM) programs, or any other kind of program, are important because they can demonstrate whether or not the program has accomplished its objectives. Furthermore, these evaluations can identify ways to improve the design of the program. These evaluations can also make successful interventions…

In the heated debate on the gap between educational research and practice, participants often defend single solutions based on monocausal problem analyses. This article aims to improve the quality of the debate by encouraging participants to take a many-sided perspective. To this purpose, we first reviewed the literature and developed an inventory…