Background: The generalizability of a study's results continues to be at the forefront of concerns in evaluation research in education (Tipton & Olsen, 2018). Over the past decade, statisticians have developed methods, mainly based on propensity scores, to improve generalizations in the absence of random sampling (Stuart et al., 2011; Tipton,…

Background: Evidence from education randomized controlled trials (RCTs) in low- and middle-income countries (LMICs) demonstrates how interventions can improve children's educational achievement [1, 2, 3, 4]. RCTs assess the impact of an intervention by comparing outcomes--aggregate test scores--between treatment and control groups. A review of…

This paper examines the scalability of the results from the Tennessee Student-Teacher Achievement Ratio (STAR) Project, a prominent educational experiment. We explore how the misalignment between the experimental design and the econometric model affects researchers' ability to learn about the intervention's scalability. We document heterogeneity…

The purpose of this study is to develop a nonparametric DIF method that (a) compares focal groups directly to the composite group that will be used to develop the reported test score scale, and (b) allows practitioners to explore for DIF related to focal groups stemming from multicategorical variables that constitute a small proportion of the…

Inquiry learning is an effective learning approach if learners are properly guided. Its effectiveness depends on learners' prior knowledge, the domain, and their relationship. In a previous study we developed an Experiment Design Tool (EDT) guiding learners in designing experiments. The EDT significantly benefited low prior knowledge learners. For…

Minimum discriminant information adjustment (MDIA), an approach to weighting samples to conform to known population information, provides a generalization of raking and poststratification. In the case of simple random sampling with replacement with uniform sampling weights, large-sample properties are available for MDIA estimates of population…

This study investigated the impact of a multicomponent training program on the American School Counselor Association's National Model of school counseling. The model was designed to enhance school counselors' competence in implementing a comprehensive school counseling program. An ABA single case design was used to collect baseline, training, and…

To plan cluster-randomized trials with sufficient statistical power to detect intervention effects on student achievement, researchers need multilevel design parameters, including measures of between-classroom and between-school differences and the amounts of variance explained by covariates at the student, classroom, and school level. Previous…

Head Start is a national program that helps young children from families with low income get ready to succeed in school. It does this by working to promote their early learning and health and their families' well-being. The Head Start Family and Child Experiences Survey (FACES) provides national information about Head Start programs and…

Ratio and proportional relationships, along with the interrelated topics of fractions,decimals, and percent, provide a critical foundation for algebra (National Mathematics Advisory Panel, 2008). Proportional reasoning, which not only requires understanding the concept of ratios and that two or more ratios are equal, also requires the ability to…

Single-case designs provide an established technology for evaluating the effects of academic interventions. Researchers interested in studying the long-term effects of reading interventions often use curriculum-based measures of reading (CBM-R) as they possess many of the desirable characteristics for use in a time-series design. The reliability…

The What Works Clearinghouse (WWC) maintains design standards to identify rigorous, internally valid education research. As education researchers advance new methodologies, the WWC must revise its standards to include an assessment of the new designs. Recently, the WWC has revised standards for two emerging study designs: regression discontinuity…

This paper aims to conduct the SD-CBL (study design with the case based learning, SD-CBL) in Epidemiology teaching and evaluate its effect. Students from five classes were recruited, and a combined comprehensive teaching model of SD-CBL was used in the "Injury Epidemiology" chapter, while other chapters in "Epidemiology"…

The roles of phonological short-term memory (pSTM) and speech perception in spoken sentence comprehension were examined in an experimental design. Deficits in pSTM and speech perception were simulated through task demands while typically-developing children (N = 71) completed a sentence-picture matching task. Children performed the control,…

Using meta-analytic techniques, we examined systematically the evidence linking friendship to academically related outcomes, asking: To what extent is friendship related to academic performance and to academically related cognitive skills? Based on 22 studies that yielded 81 effect sizes and 28 independent samples, we examined relations between…