The expansion of education technology is transforming the learning environment in classrooms, schools, school systems, online, and at home. The rise of education technology brings with it an increased opportunity for the collection and application of data, which are valuable resources for educators, schools, policymakers, researchers, and software…

Randomized evaluations of educational technology produce log data as a bi-product: highly granular data on student and teacher usage. These datasets could shed light on causal mechanisms, effect heterogeneity, or optimal use. However, there are methodological challenges: implementation is not randomized and is only defined for the treatment group,…

This paper drills deeper into the documented effects of the Cognitive Tutor Algebra I and ASSISTments intelligent tutoring systems by estimating their effects on specific problems. We start by describing a multilevel Rasch-type model that facilitates testing for differences in the effects between problems and precise problem-specific effect…

The Cognitive Tutor Algebra I (CTAI) curriculum, which includes both textbook and online components, has been shown to boost student learning by about 0.2 standard deviations in a randomized effectiveness trial. Students who were assigned to the experimental condition varied substantially in how, and how much, the used the online component of…

The Kentucky Valley Educational Cooperative and Green River Regional Educational Cooperative received an Investing in Innovation (i3) development grant from the U.S. Department of Education to implement the Creating College and Career Readiness (C3R) initiative. The initiative offered a suite of software developed by WIN Learning (WIN) to support…

This report presents findings from RAND's evaluation of the Appalachian Renaissance Initiative (ARI) in 17 districts totaling 99 kindergarten-12th grade schools within the Kentucky Valley Educational Cooperative (KVEC). The initiative took place from the 2014-2015 through 2017-2018 academic years. The evaluation examined various aspects of ARI…

Studies on blended education pay little attention to implementation, thus limiting the understanding of how such programs contribute to student math learning. This article examines the implementation of a widely used blended algebra curriculum and the relationship between implementation and student outcomes. The study was conducted in 74 middle…

In the current educational context, school models that leverage technology to personalize instruction have proliferated, as has student enrollment in, and funding of, such school models. However, even the best laid plans are subject to challenges in design and practice, particularly in the dynamic context of a school. In this collective case…

This large-scale effectiveness trial found a significant positive effect for high schools using Cognitive Tutor Algebra I (CTAI) in their second year of implementation, relative to similar schools that continued to use existing textbook-based algebra curricula. This positive result is important for educators and policymakers seeking ways to…

The purpose of this document is to descriptively summarize instructional staff responses to a survey administered by RAND in 23 personalized learning (PL) schools in Spring 2014. This work was performed at the request of the Bill & Melinda Gates Foundation (BMGF), as part of a multi-year evaluation contract. The 23 schools were selected from a…

In an ongoing study, RAND researchers are evaluating the effectiveness of Carnegie Learning's Cognitive Tutor Algebra I (CTAI) curriculum, a technology-based curriculum that combines classroom instruction with individualized instruction by a computer-based tutor. While the effectiveness of the curriculum in raising student achievement is the main…

This article examines the effectiveness of a technology-based algebra curriculum in a wide variety of middle schools and high schools in seven states. Participating schools were matched into similar pairs and randomly assigned to either continue with the current algebra curriculum for 2 years or to adopt Cognitive Tutor Algebra I (CTAI), which…

The basic concept of personalized learning (PL) -- instruction that is focused on meeting students' individual learning needs while incorporating their interests and preferences -- has been a longstanding practice in U.S. K-12 education. Options for personalization have increased as personal computing devices have become increasingly affordable…

This randomized, controlled field trial estimated the causal impact of a technology-based geometry curriculum on students' geometry achievement, as well as their attitudes toward mathematics and technology. The curriculum combines learner-centered classroom pedagogy with individualized, computer-based student instruction. Conducted over a 3-year…