We initiated and structured a single program that supervised teachers, some with neuroscience or psychology degrees, to collaborate and explore the effects of science of learning-translated pedagogy. This article reports on the 34 findings from teacher-led randomized controlled trials (RCTs) and replications. Teachers designed trials, looking at…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

Multisite research (MSR) offers the key advantages of greater statistical power and external validity via larger and more diverse participant pools. In second language acquisition (SLA) research, recent developments in meta-analysis have created a robust foundation for MSR. Although logistical and financial obstacles can complicate expansion…

This paper employs meta-analysis to determine the influence of computer-based scaffolding characteristics and study and test score quality on cognitive outcomes in science, technology, engineering, and mathematics education at the secondary, college, graduate, and adult levels. Results indicate that (a) computer-based scaffolding positively…

Currently, an increasing number of educational institutions are redefining second/foreign language (L2) classrooms by enhancing--or even replacing--traditional face-to-face (FTF) instruction with computer-assisted language learning (CALL). However, are these curricular decisions supported by research? Overall, a cursory review of empirical studies…

Research indicates that increasing teacher-directed opportunities to respond (TD-OTR) positively impacts student outcomes. Prior reviews of the empirical literature focused on outcomes for students with emotional behavioral disorders or on TD-OTRs as one of many classroom-management practices; however, prior reviews did not examine effects of…

The authors have over the years tried to revise meta-analysis because it's basic premise is to add apples and oranges together and analyze. In other words, various data on the same subject are chosen using different samples, research strategies, and number properties. The findings are then homogenized and a statistical analysis is used (Snell, J.…

This article elaborates on the centrality of interventions for social work practice and the importance of understanding the effects of interventions for a more efficient, harmless, transparent, and ethical social work practice. Low-bias research designs and meta-analyses are important means of generating the best possible evidence on what works in…

This article takes a further look at the percentage of data points exceeding the median (PEM) analysis method for single-case research data, first presented in this journal by Hsen-Hsing Ma. Ma examined the relationship between PEM and the established percentage of nonoverlapping data (PND) and then applied PEM in a meta-analysis of 61 data sets,…

The purpose of the present study is twofold: (a) to compare the validation of percentage of nonoverlapping data approach and percentage of data points exceeding the median of baseline phase (PEM) approach, and (b) to demonstrate application of the PEM approach in conducting a quantitative synthesis of single-subject research investigating the…

Reviews, analyzes, and critically assesses a sample of articles reporting research findings related to the instructional effectiveness of computer-assisted instruction (CAI). Problems in CAI research are described, including validity of the experimental research design, and current trends in CAI research are discussed. (31 references) (LRW)

This final report analyzes results of a comprehensive, integrative review of 273 primary research studies on modifying attitudes toward disabled persons. Attitude modification approaches identified included providing information, direct contact with disabled persons, vicarious experiences related to having a disability, systematic desensitization,…

The suspected sources of confounding in current meta-analytic studies of computer based instruction (CBI) are uncontrolled effects of instructional method and/or the John Henry Effect (i.e., compensatory rivalry). To determine which confounding is most plausible, a random 30% sample of the 128 studies which formed the original Kulik meta-analyses…

Primary research on student ratings of instruction is reviewed, and questions about the validity of such ratings as measures of teacher effectiveness are explored using nomological coding of 43 validity studies to examine causes of variability in coefficients of validity. Deficiencies of prior analyses and research needs are identified. (SLD)