Randomized controlled trials are a special case of designs using an unbiased instrument to take care of confounders even if they are unmeasured or unknown. Another example of studies using instrumental variables is the Mendelian experiment and Directed Acyclic Graphs show the power of such designs to enhance the internal validity. It is argued…

IQ test scores should be corrected for high stakes decisions that employ these assessments, including capital offense cases. If scores are not corrected, then diagnostic standards must change with each generation. Arguments against corrections, based on standards of practice, information present and absent in test manuals, and related issues,…

Ruscio, Seaman, D'Oriano, Stremlo, and Mahalchik (this issue) evaluate 22 bibliometric indicators, including conventional measures, like the number of publications, the "h" index, and many "h" index variants. To assess the quality of the indicators, their well-justified criteria encompass conceptual, empirical, and practical…

This article proposes a set of criteria for reporting meta-analyses of topics in learning disabilities. Application of the criteria to examples of published meta-analyses reveals the wide variation in amount of reported data, which could influence the summative results of meta-analyses and subsequent judgment of face validity. (Author/DB)

Disagrees with Levine et al.'s conclusion (published in this issue, see CS 764 297) that the three self construal scales currently in use have "severe" or "fatal" flaws. Argues that the results of Levine et al.'s meta-analysis and priming studies do not raise problems with the validity of self construal scales. Concludes that the two-dimensional…

Addresses each of the three main areas of Levine et al.'s (see this issue, CS 764 297) validity testing: mean differences in self-construals between Asians and Westerners and within individuals; priming experiments; and factor analysis of self-construal scales. Suggests that Levine et al.'s conclusions on crucial aspects of validity are untenable.…

Offers a critical rejoinder in the discussion concerning the viability of self-construal scales. Disputes the arguments to the contrary offered by Gudykunst and Lee and Kim and Raja (see this issue, CS 764 298-299). Sees the potential utility in the self-construal construction, but the three primary scales fail to meet reasonable and accepted…

Methods for selecting relevant and appropriate quasi-experimental studies for inclusion in research synthesis using the threats-to-validity approach are presented. Effects of including and excluding studies are evaluated. (BS)

In program evaluation and policy analyses, utility supplants rigor as the first and most important criterion in judging literature reviews. Although R. T. Ogawa and B. Malen emphasize rigor, a utilization-focused evaluation emphasizes purpose and audience, both of which affect the conduct of a multivocal literature review. (SLD)

Describes and discusses metanalysis and criticisms of the methodology. Reports on a pilot study which tested the feasibility of metanalytic methods in library science research using the literature on paper- or computer-based information retrieval. (28 references) (EA)

Computer-based instruction (CBI) studies analyzed by Kulik et al. were examined to explore the validity of competing claims about the computer's contribution to measured achievement gains. Results suggest achievement gains found in CBI studies are overestimated and are due to uncontrolled but robust instructional methods embedded in CBI…

The decision by the National Institute of Education panel on the effects of school desegregation to select (for meta-analysis) a small group of preferred studies based upon criteria chosen in advance of examining the studies was, in principle, a mistake. One usually cannot know until the data have been examined which of several competing…