This paper describes, and lays out an argument for, the use of a procedure to help groups of reviewers to judge the quality of prior research reports. It argues why such a procedure is needed, and how other existing approaches are only relevant to some kinds of research, meaning that a review or synthesis cannot successfully combine quality…

This conceptual methods article parallels remarks given at the 2022 American Association on Intellectual and Developmental Disabilities conference highlighting the importance of including the voices of people with intellectual disability in research processes. The purpose of this article was to put forth a call to action to disability researchers…

Multisite cluster randomized trials (MCRTs), in which, the intermediate-level clusters (e.g., classrooms) are randomly assigned to the treatment or control condition within each site (e.g., school), are among the most commonly used experimental designs across a broad range of disciplines. MCRTs often align with the theory that programs are…

The present study sought to evaluate the reproducibility of prominent findings stated by Fehr et al. in their developmental resource allocation experiment "Egalitarianism in Young Children", published in 2008. The experiment involved children making decisions about distributing sweets between themselves and either an in-group or an…

Background/Context: The reckoning with racial injustice and growing inequality that have become hallmarks of the early 2020s in the United States has implications for impact analysis and the evidence it produced for public policy decision-making. Various researchers have highlighted the shortcomings that impact analyses have when estimating the…

Latent change score (LCS) models are a powerful class of structural equation modeling that allows researchers to work with latent difference scores that minimize measurement error. LCS models define change as a function of prior status, which makes it well-suited for modeling developmental theories or processes. In LCS models, like other latent…

Having one's funding cut in the course of conducting a longitudinal study has become an increasingly real challenge faced by developmental researchers. The main purpose of the current work is to propose "post hoc" planned missing (PHPM) data designs as a promising solution in such difficult situations. This study discusses general…

Analysis of the differential treatment effects across targeted subgroups and contexts is a critical objective in many evaluations because it delineates for whom and under what conditions particular programs, therapies or treatments are effective. Unfortunately, it is unclear how to plan efficient and effective evaluations that include these…

The quality of mixing methods has been widely debated in the field of applied linguistics (AL) and the integration of data from both quantitative and qualitative research paradigms has always been open to controversy. The present study was aimed at recognizing the status quo of MMR in AL, investigating the nature of various sections of MMR…

Recruiting participants for studies of early-life longitudinal development is challenging, often resulting in practical upper bounds in sample size and missing data due to attrition. These factors pose risks for the statistical power of such studies depending on the intended analytic model. One mitigation strategy is to increase measurement…

Mixed methods research collects, analyzes, and integrates rigorous qualitative and quantitative methods to gain a deeper understanding of a phenomenon than would be gained by using either method alone. Integration is one of the key features of mixed methods research and consists of mixing qualitative and quantitative research in a systematic way…

Background: Evidence from education randomized controlled trials (RCTs) in low- and middle-income countries (LMICs) demonstrates how interventions can improve children's educational achievement [1, 2, 3, 4]. RCTs assess the impact of an intervention by comparing outcomes--aggregate test scores--between treatment and control groups. A review of…

I. Purpose of the Study: Detecting whether interventions work or not (through main effect analysis) can provide empirical evidence regarding the causal linkage between malleable factors (e.g., interventions) and learner outcomes. In complement, moderation analyses help delineate for whom and under what conditions intervention effects are most…

GAM, combining games and agent-based models, shows potential for investigating complex social phenomena. Games offer engaging environments generating insights into social dynamics, perceptions, and behaviours, while agent-based models support the analysis of complexity. Games and agent-based models share the important ability both to input and…

Recent interest in promoting replication efforts assumes that there is well-established methodological guidance for designing and implementing these studies. However, no such consensus exists in the methodology literature. This article addresses these challenges by describing design-based approaches for planning systematic replication studies. Our…