The current review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings using a total of 56 meta-analyses published in education in the 2000s. Our objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and…

This study analyzed the reporting of multilevel modeling applications of a sample of 99 articles from 13 peer-reviewed journals in education and the social sciences. A checklist, derived from the methodological literature on multilevel modeling and focusing on the issues of model development and specification, data considerations, estimation, and…

Methods for reviews of research that focus on inferring generalizations about substantive issues from a set of studies directly bearing on those issues are examined. The primary source of data was a content analysis of two samples of such reviews. (Author/RL)

Arguments supporting the use of the exploratory case method in evaluating reviews of multivocal literature are repeated, and points of general agreement with M. Q. Patton and R. F. Elmore are reviewed. Disagreement is expressed with R. K. Yin about the value of grounded theory in analyzing multivocal literature. (SLD)

Missing data analyses have received considerable recent attention in the methodological literature, and two "modern" methods, multiple imputation and maximum likelihood estimation, are recommended. The goals of this article are to (a) provide an overview of missing-data theory, maximum likelihood estimation, and multiple imputation; (b) conduct a…

Issues of reliability and validity in ethnographic design are compared to their counterparts in experimental design. Threats to the credibility of ethnographic research are summarized and categorized. Strategies intended to enhance credibility (study design, data collection, data analysis, and presentation of findings) are incorporated throughout…

R. T. Ogawa and B. Malen's article does not meet its own recommended standards for rigorous testing and presentation of its own conclusions. Use of the exploratory case study to analyze multivocal literatures is not supported, and the claim of grounded theory to analyze multivocal literatures may be stronger. (SLD)

Multivocal literatures are comprised of all accessible writings on a common topic and embody the views of diverse authors. The exploratory case study method is proposed as a way to ensure rigor in reviews of such literatures because it addresses problems associated with the selective use of data. (SLD)

Reviews of multivocal literature are assessments of what can be learned from a given body of literature and assessments of the claims on which that knowledge is based. Methodological rigor is less likely to be a problem in such reviews than is lack of independent judgment. (SLD)