Randomized A/B tests allow causal estimation without confounding but are often under-powered. This paper uses a new dataset, including over 250 randomized comparisons conducted in an online learning platform, to illustrate a method combining data from A/B tests with log data from users who were not in the experiment. Inference remains exact and…

This study explores kindergarten students' early notions of mathematical equivalence in the United States. In particular, it uses qualitative methods to examine the understandings children hold about the equal sign prior to formal instruction and how these understandings shift throughout an 8-week classroom teaching experiment designed to develop…

Low-cost devices have widened the use of multimodal data in experiments providing a more complete picture of behavioural effects. However, the accurate collection and combination of multimodal and behavioural data in a manner that enables reproducibility is challenging and often requires researchers to refine their approaches. This paper presents…

Response time variability and its changes over time have been interpreted as indicative of levels of knowledge automatization. Predominantly, only declines in variability have been examined over the course of practice and growing second language proficiency. We discuss possible scenarios that may involve increasing, rather than declining…

Tzur and Simon (2004) postulated 2 stages of development in learning a mathematical concept: participatory and anticipatory. The authors discuss the affordances for research of this stage distinction related to data analysis, task design, and assessment as demonstrated in a 2-year teaching experiment.

To identify the ways teachers and educational systems can improve learning, researchers need to make causal inferences. Analyses of existing datasets play an important role in detecting causal patterns, but conducting experiments also plays an indispensable role in this research. In this article, we advocate for experiments to be embedded in real…

Traditional knowledge-component models describe students' content knowledge (e.g., their ability to carry out problem-solving procedures or their ability to reason about a concept). In many STEM domains, instruction uses multiple visual representations such as graphs, figures, and diagrams. The use of visual representations implies a…

In this eye-tracking study, we investigated how semantics inform morphological analysis at the early stages of visual word identification in sentence reading. We exploited a feature of several derived Italian words, that is, that they can be read in a "morphologically transparent" way or in a "morphologically opaque" way…

Predicting the success or failure of a student in a course or program is a problem that has recently been addressed using data mining techniques. In this paper we evaluate some of the most popular classification and regression algorithms on this problem. We address two problems: prediction of approval/failure and prediction of grade. The former is…

Online learning from video modeling examples, in which a human model demonstrates and explains how to perform a learning task, is an effective instructional method that is increasingly used nowadays. However, model characteristics such as gender tend to differ across videos, and the model-observer similarity hypothesis suggests that such…

To investigate student difficulties in solving word problems in algebra, we carried out a teaching experiment involving 51 Indonesian students (12/13 year-old) who used a digital mathematics environment. The findings were backed up by an interview study, in which eighteen students (13/14 year-old) were involved. The perspective of mathematization,…

An opportunistic experiment is a type of randomized controlled trial that studies the effects of a planned intervention or policy change with minimal added disruption and cost. This guide defines opportunistic experiments and provides examples, discusses issues to consider when identifying potential opportunistic experiments, and outlines the…

Becoming a history teacher requires the integration of pedagogical knowledge, pedagogical content knowledge, and content knowledge. Because the integration of knowledge from different disciplines is a complex task, we investigated prompted learning journals as a method to support teacher students' knowledge integration. Fifty-two preservice…

Education planning provides the policy maker and the decision maker a logical framework in which to develop and implement education policy. At the international level, education planning is often confounded by both internal and external complexities, making the development of education policy difficult. This research presents a discrete event…

Effective teaching practices, including the ability to make data-based decisions, are necessary to close achievement gaps. The purpose of this study was to investigate the effects of a collaborative, data-based decision making (DBDM) intervention on the quality of preservice teachers' DBDM. Participants were 45 preservice general educators…