Multisite field experiments using the (generalized) randomized block design that assign treatments to individuals within sites are common in education and the social sciences. Under this design, there are two possible estimands of interest and they differ based on whether sites or blocks have fixed or random effects. When the average treatment…

Randomized experiments involving education interventions are typically implemented as cluster randomized trials, with schools serving as clusters. To design such a study, it is critical to understand the degree to which learning outcomes vary between versus within clusters (schools), specifically the intraclass correlation coefficient. It is also…

The purpose of this dissertation was to experiment with qualitative research methodologies while exploring the complexities of doctoral education, research practices, philosophies of inquiry, and other topics intersecting with(in) educational scholarship. My vision for this work was fueled by postmodernist critiques of humanist education,…

Quantitative Critical Race Theory (QuantCrit) is a burgeoning field of study seeking to challenge and improve the use of statistical data in social research. It pulls lessons and insights from Critical Race Theory and applies them to understanding social challenges. In this paper, we aim to improve the quality of quantitative research produced by…

Theories regarding the long-term effects of educational interventions are often assumed, but rarely tested using experimental methods. In the following commentary, we argue that the shortage of randomized control trials with long-term follow-up presents serious problems for the field, as it hampers our ability to develop educational programs that…

Theories regarding the long-term effects of educational interventions are often assumed, but rarely tested using experimental methods. In the following commentary, we argue that the shortage of randomized control trials with long-term follow-up presents serious problems for the field, as it hampers our ability to develop educational programs that…

This article offers a diffractive methodological intervention into workplace studies of academic life. In its engagement of a playful, performative research and writing practice, the article speaks back to technocratic organisational and sociological workplace 'time and motion' studies which centre on the human and rational, and presume a linear…

A/r/tography is often considered to be an arts and education practice-based research methodology, but this author explores a/r/tography as a pedagogical strategy that has informed the author's artistic practice and pedagogical experiments. The author tracks his own journey of entering into an a/r/trographic world and where that entering has…

Low-cost devices have widened the use of multimodal data in experiments providing a more complete picture of behavioural effects. However, the accurate collection and combination of multimodal and behavioural data in a manner that enables reproducibility is challenging and often requires researchers to refine their approaches. This paper presents…

To identify the ways teachers and educational systems can improve learning, researchers need to make causal inferences. Analyses of existing datasets play an important role in detecting causal patterns, but conducting experiments also plays an indispensable role in this research. In this article, we advocate for experiments to be embedded in real…

Evidence-based reform in education refers to policies that enable or encourage the use of programs and practices proven to be effective in rigorous research. This article discusses the increasing role of evidence in educational policy, rapid growth in availability of proven approaches, and development of reviews of research to summarize the…

Cluster randomized experiments are ubiquitous in modern education research. Although a variety of modeling approaches are used to analyze these data, perhaps the most common methodology is a normal mixed effects model where some effects, such as the treatment effect, are regarded as fixed, and others, such as the effect of group random assignment…

Curriculum aims often remain unrealised aspirations. This is because the values and principles implicit in them fail to get articulated in forms that can effectively inform and guide the practice of teaching. Ideas such as "learner-centred education", "independent/autonomous learning", "self-directed learning",…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical…