National and international large-scale assessments of mathematics show that, in most nations, males achieve better results than females and Italy is one of the countries with a greater gap. Many research studies in mathematics education have analysed this issue, using both quantitative and qualitative methods to understand the sources and…

Our nation is in the midst of one of the largest education reforms in decades centered on the adoption of the Common Core State Standards (CCSS) and aligned assessments. In an era of rising accountability measures and declining literacy proficiency, it is vital to ensure that educational resources, such as benchmark assessments, are appropriately…

Scientific models and modeling play an important role in science, and students' understanding of scientific models is essential for their understanding of scientific concepts. The measurement instrument of "Students' Understanding of Models in Science" (SUMS), developed by Treagust, Chittleborough & Mamiala ("International…

This study is an assessment of the reliability and validity analysis of Statistical Reasoning Test Survey (SRTS) instrument using the Rasch Measurement Model. The SRTS instrument was developed by the researchers to assess students' statistical reasoning in descriptive statistics among Tenth Grade science- stream students in rural schools. SRTS was…

Recent research on what students know about complex systems shows that they typically have challenges in understanding particular system ideas such as nonlinearity, complex causality, and decentralized control. Yet this research has yet to adopt a systematic approach to learning about complex systems in an ordered way in line with the Next…

The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were…

The implementation of mathematical competencies in school curricula requires assessment instruments to be aligned with this new view on mathematical mastery. However, there are concerns over whether existing assessments capture the wide variety of cognitive skills and abilities that constitute mathematical competence. The current study applied an…

Most of the tests and inventories used by counseling psychologists have been developed using CTT; IRT derives from what is called latent trait theory. A number of important differences exist between CTT- versus IRT-based approaches to both test development and evaluation, as well as the process of scoring the response profiles of individual…

Multiple matrix designs are commonly used in large-scale assessments to distribute test items to students. These designs comprise several booklets, each containing a subset of the complete item pool. Besides reducing the test burden of individual students, using various booklets allows aligning the difficulty of the presented items to the assumed…

The present study tested the possibility of operationalizing levels of knowledge acquisition based on Vygotsky's theory of cognitive growth. An assessment tool (SAM-Math) was developed to capture a hypothesized hierarchical structure of mathematical knowledge consisting of procedural, conceptual, and functional levels. In Study 1, SAM-Math was…

The objective of the present study was to evaluate the extent to which students who took a computer adaptive test of reading comprehension accounting for testlet effects were administered fewer passages and had a more precise estimate of their reading comprehension ability compared to students in the control condition. A randomized controlled…

Vocabulary knowledge is central to the process of reading comprehension (Cromely & Azevedo, 2007; Stahl & Nagy, 2005; Stanovich, 1986). The majority of our vocabulary knowledge is postulated to come from the process of incidental vocabulary acquisition (IVA) while reading (Nagy & Anderson, 1984). Prior studies have estimated an average…

Component skills and discourse frameworks of reading have identified characteristics of readers and texts that influence comprehension. However, these 2 frameworks have not previously been integrated in a comprehensive and systematic way to explain performance on any standardized assessment of reading comprehension that is in widespread use across…

The "Common European Framework of Reference" (CEFR; Council of Europe, 2001) provides a competency model that is increasingly used as a point of reference to compare language examinations. Nevertheless, aligning examinations to the CEFR proficiency levels remains a challenge. In this article, we propose a new, level-centered approach to…

The purpose of this technical report is to describe the third operational administration of the Partnership for Assessment of Readiness for College and Careers (PARCC) assessments in the 2016-2017 academic year. PARCC is a state-led consortium creating next-generation assessments that, compared to traditional K-12 assessments, more accurately…