The Cross-Classified Mixed Effects Model (CCMEM) has been demonstrated to be a flexible framework for evaluating reliability by measurement specialists. Reliability can be estimated based on the variance components of the test scores. Built upon their accomplishment, this study extends the CCMEM to be used for evaluating validity evidence.…

Computerized game-based assessment (GBA) system for screening reading difficulties may provide substantial time and cost benefits over traditional paper-and-pencil assessment while providing means also to individually adapt learning content in educational games. To study the reliability and validity of a GBA system to identify struggling readers…

At an international level, teachers' work is increasingly circumscribed and regulated. Notions of accountability have shifted from primarily inputs to primary outcomes, and investment in strengthening teacher performance evaluation has expanded. At the same time, investment in enhancing the quality of teacher education programs is contested in…

The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or "EAV," that gauges students' depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students…

Many adolescents struggle with reading comprehension, despite an emphasis on reading instruction over recent decades. Evidence suggests that informational text is particularly challenging for students. To implement assessments within a multi-tiered framework, schools must have psychometrically adequate tools. Using data of 473 students in Grades 6…

Two hundred and two (n = 202) sixth-grade students in social studies were administered a weekly vocabulary-matching curriculum-based measure (CBM) for 35 weeks. Students were also administered the Scholastic Reading Inventory (SRI), along with the annual state high-stakes test in Communication Arts. CBM scores were analyzed with respect to…

The last two decades have seen fast-moving and wholescale changes in the ways that education is now provided in French schools, in the nature of learner assessment, and in the form and scale of system evaluation. Innovation and reform have in part followed international trends, themselves triggered by the global impact of the international…

This exploratory study investigated potential sources of setting accommodation resulting in differential item functioning (DIF) on math and reading assessments for examinees with varied learning characteristics. The examinees were those who participated in large-scale assessments and were tested in either standardized or accommodated testing…

This article examines key lessons learned by Russia while developing national assessment system in education. It shows that reforms are more likely to succeed backed with sustained political support, clearly defined goals or priorities, gradual introduction, and open discussion with stakeholders. [This article was translated by Lucy Gunderson.]

Romania's education system has made impressive strides over the past two decades, with an increasing share of students mastering the basic competencies that they need for life and work. But these average improvements mask significant disparities in learning outcomes and attainment, with an increasing share of students leaving education early…

This dissertation examines a vital catalyst in the globalization of education: international assessments--that involve testing and rankings--of student achievement in academic subjects. Nearly all high-income countries participate in international assessments such as Trends in International Mathematics and Science Study (TIMSS), Progress in…

This report provides a systematic review and empirical evidence related to the experiences of middle-income countries and economies participating in the Programme for International Student Assessment (PISA), 2000 to 2015. PISA is a triennial survey that aims to evaluate education systems worldwide by testing the skills and knowledge of 15-year-old…

Eighty-seven 4th, 5th and 6th grade students were administered the "Derivational Relatedness Interview" (DRI) (Templeton, Smith, Moloney, Van Pelt, & Ives, 2009). The purpose of this instrument is to explore students' understanding of derivational morphology. During the same week, the subjects were also administered an Upper…

This study explored the relationships among the components of the Arizona Department of Education's new teacher evaluation model, with a particular focus on the extent to which ratings from the state model's teacher observation instrument differentiated higher and lower performance. The study used teacher-level evaluation data collected by the…