Treatment fidelity data are critical to evaluate intervention effectiveness, yet there are only general guidelines regarding treatment fidelity measurement. Initial investigations have found treatment fidelity data collected via direct observation to be more reliable than data collected via permanent product or self-report. However, the comparison…

This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The…

The Big Data for Education Spoke of the NSF Northeast Big Data Innovation Hub and ETS co-sponsored an educational data mining competition in which contestants were asked to predict efficient time use on the NAEP 8th grade mathematics computer-based assessment, based on the log file of a student's actions on a prior portion of the assessment. In…

We used an unobtrusive approach, keystroke logging, to examine students' cognitive states during essay writing. Based on data contained in the logs, we classified writing process data into three states: text production, long pause, and editing. We used semi-Markov processes to model the sequences of writing states and compared the state transition…

Previous studies on the effectiveness of virtual laboratories for learning have shown inconsistent results over the past decade. The purpose of this research was to explore the effects of a virtual laboratory and meta-cognitive scaffolding on students' data modeling competences. A quasi-experimental design was used. Three classes of eighth graders…

This paper connects the technological practice of activity monitor gaming to the Next Generation Science Standards (NGSS) science and engineering practice of "analyzing and interpreting data," and to the foundational constructionist idea of personal meaning. In our larger study, eighth-grade students, ages 12-14, wore physical activity…

This study investigates the effects of a scenario-based assessment design on students' writing processes. An experimental data set consisting of four design conditions was used in which the number of scenarios (one or two) and the placement of the essay task with respect to the lead-in tasks (first vs. last) were varied. Students' writing…

Building sets, video games, and scatterplots may seem unrelated, but when they are combined into a problem-based learning (PBL) lesson, these elements join to create a unique learning experience. PBL lessons drive instruction by focusing learning and activities around a central challenge or question while providing a relevant, captivating, and…

The quality of students' writing skills continues to concern educators. Because writing is essential to success in both college and career, poor writing can have lifelong consequences. Writing is now primarily done digitally, but students receive limited explicit instruction in digital writing. This lack of instruction means that students fail to…

A critical component of environmental education is to ensure student understanding and use of available technologies to better experience and analyze spatially distributed features of the environment. Combining mobile technologies with geographic information systems in field data collection may provide a unique opportunity for students to feel…

Background: We examined prevalence, incidence, and trajectory of obesity from kindergarten through grade 8 in one of the first states to implement annual surveillance. Methods: Participants included 16,414 children enrolled in kindergarten in Arkansas in 2004 with complete body mass index (BMI) measurements in kindergarten and eighth grade.…

Understanding and interpreting biased data, decision-making in accordance with the data, and critically evaluating situations involving data are among the fundamental skills necessary in the modern world. To develop these required skills, emphasis on statistical literacy in school mathematics has been gradually increased in recent years. The…

In 2012, New York education officials and the state's teachers union announced one of the nation's most aggressive programs for teacher and principal evaluation--the Annual Professional Performance Review system (APPR)--which required that 40% of an educator's evaluation be based on student growth, using a combination of the state assessment and…

Purpose: In an era of unprecedented student measurement and emphasis on data-driven educational decision making, the full potential for using data to target resources to students has yet to be realized. This study explores the utility of machine-learning techniques with large-scale administrative data to identify student dropout risk. Research…

Purpose: The purpose of this study was to investigate teacher compliance with state mandated assessment protocols and teacher accuracy in assessing student motor skill performance. Method: Middle school teachers (N = 116) submitted eighth grade student motor skill performance data from 318 physical education classes to a trained monitoring…