For the first time in 32 years, the national average scale score in mathematics dropped by seven points across the country in grades four and eight, according to the latest results of the National Assessment on Educational Progress (NAEP). The 2022 results in mathematics were staggering, in which "math performance fell for the first time in…

Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

The National Assessment of Educational Progress (NAEP) in Reading aims to measure reading comprehension for students in the United States and to monitor progress in our education system. NAEP Reading is developed based on an assessment framework document that is periodically revised to reflect the latest understandings about reading comprehension…

Using narrow test scores as the only means of accountability does not serve students, teachers, or schools. Jonathan E. Collins writes that policy makers and educators should consider accountability as an education system designed to be accountable to the best version of students. This means assessing outcomes that policy makers too easily…

Physical activity can meaningfully influence educational outcomes. However, physical activity among youth remains insufficient (World Health Organization, 2018).Youth who are not physically active are more likely to encounter chronic health issues including obesity, depression, and anxiety (Bartelink et al., 2019, Bélair et al., 2018, Krebs,…

Educators struggle to assess various aspects of reading in valid and reliable ways. Whether it is comprehension, phonological awareness, vocabulary, or phonics, determining appropriate assessments is challenging across grade levels and student abilities. Also challenging is measuring aspects of fluency: rate, accuracy, and prosody. This article…

Process Analysis is an emerging approach to discover meaningful knowledge from temporal educational data. The study presented in this paper shows how we used Process Analysis methods on the National Assessment of Educational Progress (NAEP) test data for modeling and predicting student test-taking behavior. Our process-oriented data exploration…

Linking score scales across different tests is considered speculative and fraught, even at the aggregate level (Feuer et al., 1999; Thissen, 2007). We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that…

This policy brief summarizes and critiques the findings of the US Department of Education's Section 5005 Report on Rural Education. In September of 2018, the Department of Education released the "Section 5005 Report on Rural Education: Final Report." The report was written in response to a provision of the Every Student Succeeds Act of…

Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…

Technology and engineering are increasingly being incorporated into school coursework, ranging from instruction on the use of computers and information technology within school subjects to classes that examine the role of technology in society, or courses that teach engineering design. Information communication technologies have become integral…

This guide is designed to assist States, agencies, and/or facilities who work with youth who are neglected, delinquent, or at-risk (N or D). The information in the guide will benefit those who are (a) interested in implementing pre-posttests, (b) in the process of identifying an appropriate pre-posttest, or (c) ready to evaluate current testing…

The Florida Department of Education (FDOE) identified increasing the graduation rate of students with disabilities and decreasing the graduation gap between students with disabilities and all students as its state-identified measurable result (SIMR). To make progress toward the SIMR, the state sought to build the capacity of local education…

This is an abridged version of the full assessment framework, written for a general audience. The National Assessment of Educational Progress (NAEP), otherwise known as The Nation's Report Card, informs the public about the academic achievement of elementary and secondary students in the United States. Report cards communicate the findings of…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…