Previous research has shown that treating dependent effect sizes as independent inflates the variance of the mean effect size and introduces bias by giving studies with more effect sizes more weight in the meta-analysis. This article summarizes the different approaches to handling dependence that have been advocated by methodologists, some of…

Eight studies that explored the effects of vocabulary instruction on subsequent reading comprehension found an increase in work knowledge but only a few studies reported any reading comprehension improvement. Methodological and instructional differences across studies are examined in an attempt to account for the different results. (Author/PN)

Arguments supporting the use of the exploratory case method in evaluating reviews of multivocal literature are repeated, and points of general agreement with M. Q. Patton and R. F. Elmore are reviewed. Disagreement is expressed with R. K. Yin about the value of grounded theory in analyzing multivocal literature. (SLD)

This paper first discusses methodologies employed in recent research on the composing process. It then presents results of that research in terms of the process and subprocesses of writing. It closes by discussing limitations of the methodologies and conclusions about the results. (Author)

R. T. Ogawa and B. Malen's article does not meet its own recommended standards for rigorous testing and presentation of its own conclusions. Use of the exploratory case study to analyze multivocal literatures is not supported, and the claim of grounded theory to analyze multivocal literatures may be stronger. (SLD)

Multivocal literatures are comprised of all accessible writings on a common topic and embody the views of diverse authors. The exploratory case study method is proposed as a way to ensure rigor in reviews of such literatures because it addresses problems associated with the selective use of data. (SLD)

In program evaluation and policy analyses, utility supplants rigor as the first and most important criterion in judging literature reviews. Although R. T. Ogawa and B. Malen emphasize rigor, a utilization-focused evaluation emphasizes purpose and audience, both of which affect the conduct of a multivocal literature review. (SLD)

Reviews of multivocal literature are assessments of what can be learned from a given body of literature and assessments of the claims on which that knowledge is based. Methodological rigor is less likely to be a problem in such reviews than is lack of independent judgment. (SLD)