Productive dialogue is informed best by multiple and diverse voices. Five seasoned evaluators, representing a range of evaluation perspectives, offer their views in two- to three-page discussant contributions. These individuals were asked to reflect and comment on the previous chapters in the spirit of critical review as a key source of evidence…

To look for the answers of "What is the relationship between "ethics" and "quality" in education research?," this article explores factors that bind the two too tightly together for extrication, including representation of subject and researcher mindsets, the setting of research agendas, research design and funding. Using research in autism as a…

This article describes the design and evaluation approaches to address the complexity posed by systems change initiatives. The role of evaluations in addressing the following issues is briefly reviewed: moving from strategic planning to implementation, impacts on system-level coordination, anticipated timeline of impact, and individual level…

This article contains reflections provoked by the articles in this volume of "The Counseling Psychologist." As a relative outsider to counseling psychology, the author thoroughly enjoyed immersing herself in these contributions and then extracting a set of thoughts inspired by the writers.

A debate is emerging concerning the use of deception in social science research (especially when it employs experimental methods), driven primarily by the relatively recent move by many economists into experimental work. These economists generally argue that deception should be banned. Deception includes a variety of practices in social science…

The author believes that a unified theory might provide ideas helpful for improving research; professional training and practice; and therefore, student achievement. Little attention was paid to how several variables might work together and there is little discussion regarding how they might work together. The author stresses that there are…

D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…

This essay argues for the value of an ecological metaphor in conceptualizing, designing, and enacting research in writing studies. Such a metaphor conceives of activities, actors, situations, and phenomena as interdependent, diverse, and fused through feedback. This ecological orientation invites composition scholars to research rhetorically: to…

One confronts many difficulties when conducting policy-relevant criminal justice research that focuses on American Indian interests. Foremost among these difficulties is the great variation in relevant contexts that apply to this area of research. From the urban context of large American cities, where American Indians constitute a slim minority…

This response to Slavin's article (2008) explores the issues of transparency, representation, and warranting of claims in Slavin's descriptions of the work of others and his suggestions for program evaluation syntheses. Through contrastive analyses between Slavin's representations of the program evaluation synthesis efforts of five organizations…

Responding to Bulterman-Bos (2008), the author argues that the effort to make education research more relevant is counterproductive. Teachers and researchers have different orientations toward education that arise from different institutional settings, occupational constraints, daily work demands, and professional incentives. These are not…

After being told in an end-of-year job review that performances are not considered valuable research outcomes, the author argues in this essay that performance matters. This essay makes a case for recognizing performance ethnographies as research, pedagogy, and active service and concludes with guidelines for performance ethnographers who are…

In response to Bulterman-Bos (2008), this article discusses three kinds of research needed in education: problem-finding research, which helps frame good research questions; problem-solving research, which helps illuminate educational problems; and translational work, which transforms the findings of research into tools that practitioners and…

As a practitioner who has worked with youngsters with attention deficit hyperactivity disorder (ADHD) for the past 30 years, the author has done her best to stay current with the research literature on ADHD, particularly intervention research. However, she was always bothered by one nagging thought. Sure, there is good research to show effective…

"Theory as Method: Small Theories of Treatments," by Mark W. Lipsey, is one of the most influential and highly cited articles to appear in "New Directions for Evaluation." It articulated an approach in which methods for studying causation depend, in large part, on what is known about the theory underlying the program. Lipsey discussed the benefits…