The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Reading motivation is an important contributor to reading achievement. Students with higher levels of motivation tend to outperform those with lower levels. Reading motivation is a dynamic, situational, context-dependent trait that can vary in children over time and across tasks. Teachers have a valuable opportunity to support students' reading…

In studies of educational achievement, students' self-reported number of books in the family home is a frequently used proxy for social, cultural, and economic background. Absent hard evidence about what this variable captures or how well, its use has been motivated by strong associations with student outcomes. I show that these associations rest…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

Up until 2020, National Assessment of Educational Progress (NAEP) reading scores had increased only slightly since the early 1990s with large achievement gaps for students of color and students living in poverty. Modest gains in fourth grade reading proficiency since 1992 were erased during the pandemic. The insufficient progress in reading even…

Although literacy achievement has improved in Chile, adolescents' underperformance in reading comprehension is still a serious concern. In English, core academic-language skills (CALS) have been found to significantly predict reading comprehension, even controlling for academic vocabulary knowledge. CALS are high-utility language skills that…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

This study examined the applicability of the Arabic version of the Curriculum Based Measurement Maze (CBM Maze) for Jordanian students. A sample of 150 students was recruited from two public primary schools in Jordan. The students were ranked into high, moderate, and low achievers in terms of their performance in the Arabic course. Then all of…

The articles in this special issue make two important contributions to our understanding of the impact of accommodations on test score validity. First, they illustrate a variety of methods for collection and rigorous analyses of empirical data that can supplant expert judgment of the impact of accommodations. These methods range from internal…

Teacher judgments about students' academic abilities are important for instructional decision making and potential special education entitlement decisions. However, the small number of studies evaluating teachers' judgments are limited methodologically (e.g., sample size, procedural sophistication) and have yet to answer important questions…

The relationship between students' family background and achievement is often seen as an important topic in regard to equality and equity of educational provision. The results of various education studies show that the family background of students correlates with students' academic achievement at school. This paper focuses on the measurement of…

In addition to collecting achievement data, international large-scale assessment programmes gather auxiliary information from students and schools regarding the context of teaching and learning. In an effort to clarify some of the opacity surrounding international large-scale assessment programmes and the potential problems associated with less…

During the past decade, the use of standardized benchmark measures to differentiate and individualize instruction for students received renewed attention from educators. Although teachers may use their own assessments (tests, quizzes, homework, problem sets) for monitoring learning, it is challenging for them to equate performance on classroom…

Reading deficits among students with emotional and behavioral disorders (E/BD) are well documented. One approach to addressing these deficits has been providing students with intensive and explicit reading instruction. In this study, 31 students with E/BD and reading deficits in self-contained settings were provided with 8 weeks of…

Recently, educational researchers and practitioners have turned to value-added models to evaluate teacher performance. Although value-added estimates depend on the assessment used to measure student achievement, the importance of outcome selection has received scant attention in the literature. Using data from a large, urban school district, I…