Progressing from additive to multiplicative thinking is a key outcome of school mathematics, making ratios an essential topic of study in junior secondary. In this study, 15 Australian Year 8 students were administered a ratio test followed by semi-structured interviews to explore their conceptions of ratio prior to formal instruction. In this…

In test equating, one critical equating property is the group invariance property which indicates that the equating function used to convert performance on each alternate form to the reporting scale should be the same for various subgroups. To mitigate the impact of disrupted learning on the item parameters during the COVID-19 pandemic, a…

This study aims to compare the performance of different small sample equating methods in the presence and absence of differential item functioning (DIF) in common items. In this research, Tucker linear equating, Levine linear equating, unsmoothed and pre-smoothed (C=4) chained equipercentile equating, and simplified circle arc equating methods…

The research shared in this conference paper report illustrates how an iterative process to item development that involves expert review and cognitive lab interviews with students can be used to collect evidence of validity for assessment items. Analysis of students' reasoning was also used to expand a model for identifying conceptions and…

This study is part of a larger effort to investigate linguistic features of assessment items that might explain differential performance of English learners on science assessments. An analysis of a large set of multiple-choice items suggested two features that held promise in reducing the performance gap: the presence of contrast words and the…

In this paper, we undertake a content analysis of mathematics assessment tasks to understand how often graphical representations are embedded within high-stakes national and international tests. A total of 274 items were analysed, consisting of 160 Grade 9 UN items, 88 Grade 8 TIMSS items, and 26 PISA items. Analysis showed that all items in the…

This paper describes the extent to which the science content in the Next Generation Science Standards (NGSS) is similar to that in the science assessment frameworks for the National Assessment of Educational Progress (NAEP) and the Trends in International Mathematics and Science Study (TIMSS) at the middle school level. Using NAEP as a common…

Students often have trouble understanding key biology ideas, in part because they lack an understanding of foundational chemistry ideas. AAAS [American Association for the Advancement of Science] is collaborating with BSCS [Biological Sciences Curriculum Study] in the development of a curriculum unit that connects core chemistry and biology ideas…

The least squares distance method (LSDM) was used in a cognitive diagnostic analysis of TIMSS (Trends in International Mathematics and Science Study) items administered to 4,498 8th-grade students from seven geographical regions of Turkey, extending analysis of attributes from content to process and skill attributes. Logit item positions were…

Students often have trouble understanding key biology ideas because they lack an understanding of foundational chemistry ideas. AAAS Project 2061 is collaborating with BSCS in the development a curriculum unit that connects core chemistry and biochemistry ideas in order to help eighth grade students build the conceptual foundation needed for high…

Educational assessment is a process of collecting evidence and interpreting it to provide instructors with information regarding students' learning. However, the current design and scoring of most standardized educational tests are insufficient to serve this purpose. The limitation exists primarily due to the lack of cognitive information…

In 1998 and again in 2002, samples of eighth grade students in California were tested in reading as part of the state-level component of the National Assessment of Educational Progress (NAEP). In each of these years, all eighth graders in the state were also required to participate in the state's accountability testing, which included the reading…

Two 50-item multiple-choice forms of a grammar test were developed differing only in humor being included in 20 items of one form. One hundred twenty-six (126) eighth graders received the test plus alternate forms of a questionnaire. Humor inclusion did not affect grammar scores on matched humorous/nonhumorous items nor on common post-treatment…

The development and use of item shells in the construction of a series of standardized tests of reading comprehension at the elementary school level are described. An item shell is an item that is devoid of specific content, but contains key words and a distinctive syntactic structure. The specific content of the item shell varies depending on the…

The main purpose of this study was to illustrate a polytomous IRT-based linking procedure that adjusts for rater variations. Test scores from two administrations of a statewide reading assessment were used. An anchor set of Year 1 students' constructed responses were rescored by Year 2 raters. To adjust for year-to-year rater variation in IRT…