During the 1990s, the use of meta-analytic methods in educational research has been widespread, and few aspects of education have escaped the meta-analytic revolution. The acceptance has not been complete, however, and several threats to validity remain. Prominent among these are the "normality" problem and the "independence"…

This paper summarizes the results of a quantitative review of the validity of the employment interview. It begins by discussing factors that make the interpretation of interview validity data difficult. The interpretation of interview validity data is shown to be hampered by the heterogeneity of constructs and measurement methods in the interview.…

Some of the frustrations inherent in trying to incorporate qualifications of statistical results into meta-analysis are reviewed, and some solutions are proposed to prevent the loss of information in meta-analytic reports. The validity of a meta-analysis depends on several factors, including the: thoroughness of the literature search; selection of…

The debate over whether the 50 states are meaningful units for macro-sociological research has mostly been conducted on the basis of deductive reasoning. Three sets of analyses that are intended to provide much needed empirical data on this issue were studied. The first set involved all variables in the "County and City Data Book" used…

Validity generalization meta-analysis (VG) examines the extent to which the validity of an instrument can be transported across settings. VG offers correction and summarization procedures designed in part to remove the effects of statistical artifacts on estimates of association between criterion and predictor. By employing a random effects model,…

A study examined the extent to which existing data on communication apprehension (CA) can be employed to accurately reflect the cultural differences observed. The impact of those findings on the understanding of the nature of CA as it occurs in multiple cultures was also examined. Ten research reports that contained quantitative information that…

This paper focuses on a critical analysis and reanalysis of two earlier multisection validity meta-analyses of student ratings of instruction. The reanalysis is based on a sharpening of criteria for: (1) including studies in the meta-analysis; (2) defining key study characteristics that influence results; and (3) calculating the correlational…

To maximize knowledge from existing studies and to determine how job satisfaction constructs have been operationalized in the field of educational administration over the last quarter century, reliable and valid procedures must be developed to synthesize findings from the studies empirically. This study synthesizes empirical findings on job…

Because research synthesis enables one to determine either the overall effectiveness of a particular treatment or the relative effectiveness of different types of treatments, it is becoming increasingly popular as a tool in program evaluation. Numerous methodological problems arise, however, when research synthesis is applied to studies conducted…

Some methodological issues in the study of levels of knowledge are reviewed, and needs for further research are explored, drawing on an analysis of 12 studies reported since the late 1970s. In the 12 studies, 16 quantitative experiments were conducted. These were assessed for internal and external validity. Analysis revealed some shortcomings in…

The suspected sources of confounding in current meta-analytic studies of computer based instruction (CBI) are uncontrolled effects of instructional method and/or the John Henry Effect (i.e., compensatory rivalry). To determine which confounding is most plausible, a random 30% sample of the 128 studies which formed the original Kulik meta-analyses…

Quantitative research on feedback that college teachers receive from student ratings is methodologically critiqued. The critique is based on a recently completed review and statistical study of 28 related studies by R. L'Hommedieu, R. J. Menges, and K. T. Brinko. Feedback effects may be stronger than research indicates. (SLD)

International comparisons in educational research can be difficult to accomplish because the findings of individual countries may not be comparable due to study design or inherent country features that cannot be manipulated. Quantitative meta-analysis techniques have great potential in improving international comparisons. In this paper,…

Forty studies using one or more components of Lozanov's method of suggestive-accelerative learning and teaching were identified from a search of all issues of the "Journal of Suggestive-Accelerative Learning and Teaching." Fourteen studies contained sufficient statistics to compute effect sizes. The studies were coded according to substantive and…