Despite their many benefits, longitudinal studies are much less common than one-time data collection or pre-post intervention designs. One reason for their scarcity is that longitudinal studies introduce requirements and challenges that non-longitudinal studies do not. One of the biggest challenges is participant attrition. In order to help…

Background/Context: Attrition has been described as "the Achilles Heel of the randomized experiment" (Shadish et al., 1998 p.3). Attrition looms as a threat because it can undermine group equivalence, eroding the methodological strength at the heart of a randomized evaluation. In particular, attrition could result in unobserved…

This paper seeks to raise awareness among educational researchers and practitioners of some significant weaknesses and internal contradictions of randomised control trials (RCTs). Although critiques throughout the years from education scholars have pointed to the detrimental effects of this experimental approach on education practice and values,…

Background: Randomised controlled trials (RCTs) have long been considered the gold standard in education research. Federal funds are allocated to evaluations that meet What Works Clearinghouse standards; RCT designs are required in order to meet these standards without reservations. Schools seek out interventions that are research based, in other…

Evaluators of education interventions are increasingly designing studies to detect impacts much smaller than the 0.20 standard deviations that Cohen characterized as "small." While the need to detect smaller impacts is based on compelling arguments that such impacts are substantively meaningful, the drive to detect smaller impacts may…

Context: Assessments of baseline equivalency of intervention and control groups, "balance," play a critical role in evaluating educational interventions. The highest What Works Clearinghouse (WWC) of the Institute of Educational Studies (IES) standard for educational studies, "Meets WWC Design Standards Without Reservations,"…

Evaluators of education interventions increasingly need to design studies to detect impacts much smaller than the 0.20 standard deviations that Cohen (1988) characterized as "small." For example, an evaluation of Response to Intervention from the Institute of Education Sciences (IES) detected impacts ranging from 0.13 to 0.17 standard…

"Attrition" is the loss of sample during the course of a study. It occurs when individuals initially randomly assigned in a study are not included when researchers examine the outcome of interest. Attrition is a common issue in education research, and it occurs for many reasons. The What Works Clearinghouse (WWC) is an initiative of the…

This study aims to explore the current published research on Language Massive Open Online Courses (LMOOCs), outlining the types of papers, countries where studies were performed and institutions devoted to this field. Also, it intends to classify the reviewed literature following a general categorisation of MOOCs, and to identify the main trends…

This paper describes and demonstrates a new online resource developed to help researchers proactively plan for student attrition: the Student Attrition Lookup Tool (SALT). With SALT, researchers can access student mobility estimates for different student and school subpopulations and for different transition periods from kindergarten to grade 12.…

Large-scale randomized studies provide the best means of evaluating practical, replicable approaches to improving educational outcomes. This article discusses the advantages, problems, and pitfalls of these evaluations, focusing on alternative methods of randomization, recruitment, ensuring high-quality implementation, dealing with attrition, and…

Background: The Education Endowment Foundation (EEF) is an independent charity that was established in 2011 with the explicit aim of breaking the link between family income and educational achievement in England. Over the seven years since its inception, EEF has contributed to the existing evidence base by funding over one hundred randomised…

Evaluators of education interventions are increasingly designing studies to detect impacts much smaller than the 0.20 standard deviations that Cohen (1988) characterized as "small." While the need to detect smaller impacts is based on compelling arguments that such impacts are substantively meaningful, the drive to detect smaller impacts…

Attrition occurs when members of the initial research sample are not part of the final analysis sample, such as due to missing data or leaving the study. Both the overall sample attrition and the differences in attrition between the groups can affect the statistical equivalence of the sample and create potential for bias. The WWC has given careful…

Meeting the What Works Clearinghouse (WWC) attrition standard (or one of the attrition standards based on the WWC standard) is now an important consideration for researchers conducting studies that could potentially be reviewed by the WWC (or other evidence reviews). Understanding the basis of this standard is valuable for anyone seeking to meet…