Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Do quasi-experimental (QE) studies conducted with baseline covariates that are typically available in the longitudinal administrative state databases yield unbiased effect estimates? This paper conducts a within-study comparison (WSC) study that compares experimental impacts of early college high school (ECHS) attendance with QE impacts drawn from…

Background: Special education services are individualized supports provided to students with disabilities (SWD) that should help them make appropriate educational progress given their abilities, educational needs, and goals (Endrew F. v. Douglas County School District, 2017). Concerns about the benefits of these services have emerged given the…

Experimental studies are often employed to test the effectiveness of teaching innovations such as new pedagogy, curriculum, or learning resources. This article offers guidance on good practice in developing research designs, and in drawing conclusions from published reports. Random control trials potentially support the use of statistical…

Quasi-experiments are common in studies that estimate the effect of instructional interventions on student performance outcomes. In this type of research, the nature of the experimental design, the choice in assessment, the selection of comparison groups, and the statistical methods used to analyze the comparison data dictate the validity of…

The present study sought to evaluate the effects of a reading strategy instructional program on the reading competence of third-grade students. Students were instructed in fluent and strategic reading by trained research assistants in whole class settings and subsequently worked on expository text material together with peers. Their reading…

We evaluate the use of text-to-speech (TTS) technology for audio computer-assisted self-interviewing (ACASI). We use a quasi-experimental design, comparing the use of recorded human voice in the 2006-2010 National Survey of Family Growth with the use of TTS in the first year of the 2011-2013 survey, where the essential survey conditions are…

Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

Studies have pointed to the benefits of physical activity (PA), yet the level of PA participation among preschoolers is low. This in turn could have resulted in the limited research literature on the PA level or physical education curriculum (PEC) of preschool children. Those reviewed here are mostly from countries in the West, as those from Asia…

The credibility of unsupervised exams, one of the biggest challenges of e-learning, is currently maintained by proctoring. However, little has been done to determine whether expensive and inconvenient proctoring is necessary. The purpose of this quantitative study was to determine whether the use of security mechanisms, based on the taxonomy of…

The regression discontinuity (RD) design is a popular quasi-experimental design for causal inference and policy evaluation. The most common inference approaches in RD designs employ "flexible" parametric and nonparametric local polynomial methods, which rely on extrapolation and large-sample approximations of conditional expectations…

Both quizzes and reflections have been found to benefit student learning, but have been typically compared to passive or superficial controls. The purpose of this quasi-experiment is to test the relative effectiveness of brief quizzes followed by reflections compared to longer quizzes. Participants (N = 218) were introductory psychology students…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

This quasi-experimental investigation describes the influence of text signals on second language expository science text comprehension. In two course sections, mixed proficiency Korean English language learners (n = 88) read one of two print-based English expository text passage versions. Participants in one section (n = 44) were given a version…

Rigorous scholarship is essential to the continued growth of group work, yet the unique nature of this counseling specialty poses challenges for quantitative researchers. The purpose of this proposal is to overview unique challenges to quantitative research with groups in the counseling field, including difficulty in obtaining large sample sizes…