Considerable thought is often put into designing randomized control trials (RCTs). From power analyses and complex sampling designs implemented preintervention to nuanced quasi-experimental models used to estimate treatment effects postintervention, RCT design can be quite complicated. Yet when psychological constructs measured using survey scales…

Propensity score weighting often is used to correct for attrition biases in panel surveys. While methodological literature exists on the logic of propensity score weighting and its practical applications, an in-depth discussion is lacking on the effects of using this weighting to correct for attrition biases in attitudinal, behavioral, and…

Postelection surveys regularly overestimate voter turnout by 10 points or more. This article provides the first comprehensive documentation of the turnout gap in three major ongoing surveys (the General Social Survey, Current Population Survey, and American National Election Studies), evaluates explanations for it, interprets its significance, and…

Inherent in applied developmental sciences is the threat to validity and generalizability due to missing data as a result of participant drop-out. The current paper provides an overview of how attrition should be reported, which tests can examine the potential of bias due to attrition (e.g., t-tests, logistic regression, Little's MCAR test,…

"Attrition" is the loss of sample during the course of a study. It occurs when individuals initially randomly assigned in a study are not included when researchers examine the outcome of interest. Attrition is a common issue in education research, and it occurs for many reasons. The What Works Clearinghouse (WWC) is an initiative of the…

Small-study effects are a common threat in systematic reviews and may indicate publication bias. Their existence is often verified by visual inspection of the funnel plot. Formal tests to assess the presence of funnel plot asymmetry typically estimate the association between the reported effect size and their standard error, the total sample size,…

Respondent incentives are widely used to increase response rates, but their effect on nonresponse bias has not been researched as much. To contribute to the research, we analyze an incentive experiment embedded within the third wave of the German household panel survey "Panel Labor Market and Social Security" conducted by the German…

Attrition occurs when study participants who were assigned to the treatment and control conditions do not provide outcome data and thus do not contribute to the estimation of the treatment effects. It is very common in experimental studies in education as illustrated, for instance, in a meta-analysis studying "the effects of attrition on baseline…

This paper introduces a variation on the post-test only cohort control design and addresses questions concerning both the methodological credibility and the practical utility of employing this design variation in evaluations of large-scale complex professional development programmes in mathematics education. The original design and design…

Effective early childhood intervention and child care policies should be based on an understanding of the effects of child care quality and type on child well-being. This article describes methods for securing unbiased estimates of these effects from nonexperimental data. It focuses on longitudinal studies like the one developed by the National…