Understanding when it is appropriate to make causal inferences from a statistical result is a fundamental skill for science literacy. Prior research has concentrated on erroneous causal judgments about observational studies, but there is little research on whether people understand that experiments provide stronger justification for causal claims.…

Single-case design (SCD) methodology, in which data are displayed in a line graph, can be helpful in determining intervention effectiveness in research and practice. Using visual inspection of graphed data, researchers and practitioners can explore the existence of a functional relationship between implementation of the intervention and a…

Multilevel meta-analysis is an innovative synthesis technique used for the quantitative integration of effect size estimates across participants and across studies. The quantitative summary allows for objective, evidence-based, and informed decisions in research, practice, and policy. Based on previous methodological work, the technique results in…

Researchers commonly interpret effect sizes by applying benchmarks proposed by Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability. In…

Experimental research in education and training programs typically involves administering treatment to whole groups of individuals. As such, researchers rely on the estimation of design parameter values to conduct power analyses to efficiently plan their studies to detect desired effects. In this study, we present design parameter estimates from a…

Researchers designing multisite and cluster randomized trials of educational interventions will usually conduct a power analysis in the planning stage of the study. To conduct the power analysis, researchers often use estimates of intracluster correlation coefficients and effect sizes derived from an analysis of survey data. When there is…

In areas of emerging research, such as supporting teachers' classroom management, replication of research is critical to ensuring that recommendations for the field are based on sound science and appropriate for the contexts to which they are being applied. This article describes a replication of research on efficient professional development…

An appropriate estimate of statistical power is critical for the design of intervention studies. Although the inclusion of a pretest covariate in the test of the primary outcome can increase statistical power, samples selected on the basis of pretest performance may demonstrate range restriction on the selection measure and other correlated…

The identification of evidence-based practices continues to provoke issues of disagreement across multiple fields. One area of contention is the role of single-subject design (SSD) research in providing scientific evidence. The debate about SSD's utility centers on three issues: sample size, effect size, and serial dependence. One potential…

In order to better assist practitioners and better serve persons with autism spectrum disorders (ASD) and their families, it is vital for professionals to systematically evaluate the existing body of literature and synthesize its scientific evidence, so that the efficacy of research can be translated to evidence-based practices (EBPs) (Wheeler,…

The purpose of this study was to identify the characteristics of a representative sample of single-case designs that appear in the published literature. The study located, digitized, and coded all 809 single-case designs appearing in 113 studies in the year 2008 in 21 journals in a variety of fields in psychology and education. Coded variables…

This paper compares the effectiveness of two interventions aimed to improve teaching quality and student achievement in Indonesia. The first intervention was the use of education standards, while the second one was the combination of education standards with a teacher improvement program. The study involved 50 schools, 52 teachers, and 1660…

Findings from empirical research suggest that both self-efficacy beliefs and collaborative learning may have an influence upon student academic performance. However, the phenomena of self-efficacy beliefs, collaborative learning, and academic achievement have not been studied in concert with one another. Using quantitative research methods, I…

Interventions based on the results of functional behavioral assessment (FBA) have been the topic of extensive research and, in certain cases, mandated for students with disabilities under the Individuals With Disabilities Education Act. There exist a wide variety of methods for conducting such assessments, with little consensus in the field. The…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…