This response to Slavin's article (2008) explores the issues of transparency, representation, and warranting of claims in Slavin's descriptions of the work of others and his suggestions for program evaluation syntheses. Through contrastive analyses between Slavin's representations of the program evaluation synthesis efforts of five organizations…

The terms "rigor" and "relevance" most often surface in discussions of methodological adequacy. Assessing epistemological relevance is equivalent to answering the question, "Is this particular research question worth asking at all?" Epistemological rigor refers to the properties of a "researchable" problem.…

The design and conduct of a national evaluation study is discussed, demonstrating that a control group may not provide the no-cause baseline information expected. Resolution of this problem requires reexamination of paradigms, research practices, and policies, as well as the underlying real world constraints and views that generate them. (PN)

Research practitioners have traditionally collected and analyzed data using experimental designs and inferential statistical procedures. In addition to being difficult to learn and apply, these quantitative procedures generally leave out such variables as attitudes, feelings, and emotions. This paper describes the nature and role of qualitative…

This study of evaluation utilization identified organizational, political, and practical arrangements facilitating the wide use of "The Interim Report Evaluation" in policymaking for California's Early Childhood Education Program. In a program fraught by tensions, where evaluations had been political tools, this evaluation was special.…

The preliminary results of four of six research methodologies used to evaluate a professional development curriculum in an urban school are described and reported. The paper begins with a discussion of the social systems model underlying the project, a brief summary of the transactional evaluation scheme used to direct research efforts, a…