Cluster randomized control trials often incorporate a longitudinal component where, for example, students are followed over time and student outcomes are measured repeatedly. Besides examining how intervention effects induce changes in outcomes, researchers are sometimes also interested in exploring whether intervention effects on outcomes are…

Education experiments frequently assign students to treatment or control conditions within schools. Longitudinal components added in these studies (e.g., students followed over time) allow researchers to assess treatment effects in average rates of change (e.g., linear or quadratic). We provide methods for a priori power analysis in three-level…

This study discusses quantile regression methodology and its usefulness in education and social science research. First, quantile regression is defined and its advantages vis-à-vis vis ordinary least squares regression are illustrated. Second, specific comparisons are made between ordinary least squares and quantile regression methods. Third, the…

The purpose of this study is extend previous methods by Raudenbush and Liu (2001) and Spybrook et al. (2011), and provide methods for power analysis of tests of treatment effects in studies of polynomial change with two levels of nesting (e.g., students and schools) where the treatment is either at the third level (e.g., school intervention) or at…

Field experiments in education frequently assign entire groups such as schools to treatment or control conditions. These experiments incorporate sometimes a longitudinal component where for example students are followed over time to assess differences in the average rate of linear change, or rate of acceleration. In this study, we provide methods…

Policies about reducing class size have been implemented in the US and Europe in the past decades. Only a few studies have discussed the effects of class size at different levels of student achievement, and their findings have been mixed. We employ quantile regression analysis, coupled with instrumental variables, to examine the causal effects of…

Large-scale experiments that involve nested structures may assign treatment conditions either to subgroups such as classrooms or to individuals such as students within subgroups. Key aspects of the design of such experiments include knowledge of the variance structure in higher levels and the sample sizes necessary to reach sufficient power to…

The authors examined differential effects of interim assessments on minority and low socioeconomic status students' achievement in Grades K-6. They conducted a large-scale cluster randomized experiment in 2009-2010 to evaluate the impact of Indiana's policy initiative introducing interim assessments statewide. The authors used 2-level models to…

In a previous study, Mix et al. (2016) reported that spatial skill and mathematics were composed of 2 highly correlated, domain-specific factors, with a few cross-domain loadings. The overall structure was consistent across grade (kindergarten, 3rd grade, 6th grade), but the cross-domain loadings varied with age. The present study sought to…

In a previous study, Mix et al. (2016) reported that spatial skill and mathematics were composed of 2 highly correlated, domain-specific factors, with a few cross-domain loadings. The overall structure was consistent across grade (kindergarten, 3rd grade, 6th grade), but the cross-domain loadings varied with age. The present study sought to…

Field experiments with nested structures are becoming increasingly common, especially designs that assign randomly entire clusters such as schools to a treatment and a control group. In such large-scale cluster randomized studies the challenge is to obtain sufficient power of the test of the treatment effect. The objective is to maximize power…

Field experiments with nested structures assign entire groups such as schools to treatment and control conditions. Key aspects of such cluster randomized experiments include knowledge of the intraclass correlation structure and the sample sizes necessary to achieve adequate power to detect the treatment effect. The units at each level of the…

Interim assessments are increasingly common in U.S. schools. We use high-quality data from a large-scale school-level cluster randomized experiment to examine the impact of two well-known commercial interim assessment programs on mathematics and reading achievement in Indiana. Results indicate that the treatment effects are positive but not…

Teachers spend most of their time in school in classrooms, and their instruction and teaching practices may be affected by classroom context such as class size. We examine whether teacher effects interact with classroom context such as class size. Specifically, we seek to determine whether teacher effects are more pronounced in small classes than…

Field experiments that involve nested structures frequently assign treatment conditions to entire groups (such as schools). A key aspect of the design of such experiments includes knowledge of the clustering effects that are often expressed via intraclass correlation. This study provides methods for constructing a more powerful test for the…