Progressing from additive to multiplicative thinking is a key outcome of school mathematics, making ratios an essential topic of study in junior secondary. In this study, 15 Australian Year 8 students were administered a ratio test followed by semi-structured interviews to explore their conceptions of ratio prior to formal instruction. In this…

It has become a critical question what the reliability level would be when open-ended questions are used in large-scale selection tests. One of the aims of the present study is to determine what the reliability would be in the event that the answers given by test-takers are scored by experts when open-ended short answer questions are used in…

This study examined the existence of latent classes in TIMSS 2015 data from three countries, Singapure, Turkey and South Africa, were analyzed using Mixture Item Response Theory (MixIRT) models (Rasch, 1PL, 2PL and 3PL) on 18 multiple-choice items in the science subtest. Based on the findings, it was concluded that the data obtained from TIMSS…

Purpose: Certain changes occurred in measurement and evaluation systems, centralized exams and exams implemented in schools in alignment with developments in the world. Our mean scores in exams including PISA and TIMMS were lower than other countries. This led the Ministry of Education to introduce skills-based questions in exams with the purpose…

In online environments, listening involves being able to pause or replay the recording as needed. Previous research indicates that control over the listening input could improve the measurement accuracy of listening assessment. Self-pacing also supports the second language (L2) comprehension processes of test-takers with specific learning…

In science, graphs are used to visualise data, relationships and scientific principles. Basic graph reading operations, i.e. reading single data points, recognising trends as well as conducting small extrapolations from the data are important skills for pupils and lay the groundwork for a comprehensive understanding of data visualisations across…

This study is part of a larger effort to investigate linguistic features of assessment items that might explain differential performance of English learners on science assessments. An analysis of a large set of multiple-choice items suggested two features that held promise in reducing the performance gap: the presence of contrast words and the…

In this paper, we undertake a content analysis of mathematics assessment tasks to understand how often graphical representations are embedded within high-stakes national and international tests. A total of 274 items were analysed, consisting of 160 Grade 9 UN items, 88 Grade 8 TIMSS items, and 26 PISA items. Analysis showed that all items in the…

Much debate surrounds the issue of whether allowing candidates to listen to recordings twice is more desirable in language tests than offering just one opportunity. Using regression models, this study investigates, analyses and interconnects both item difficulty and stimulus length in relation to the frequency of stimulus presentation and its…

Changing the order of items between alternate test forms to prevent copying and to enhance test security is a common practice in achievement testing. However, these changes in item order may affect item and test characteristics. Several procedures have been proposed for studying these item-order effects. The present study explores the use of…

The aim of this study is to determine the items in Science and Technology and Mathematics subtests of 6th, 7th, and 8th grades in the 2009 LDE, which was performed to select the students for the secondary schools, exhibited item bias with regard to student gender. Mantel-Haenszel (MH) method was used in order to determine the differential item…

This document outlines the framework and assessment design for the International Civic and Citizenship Education Study (ICCS) sponsored by the International Association for the Evaluation of Educational Achievement (IEA). Over the past 50 years, IEA has conducted comparative research studies focusing on educational policies, practices, and…

The "sciences humaines" provincial assessment was conducted in June 1991 in Franco-Manitoban (Canadian) schools and in the French immersion program. Tests were administered to students in grades 8 and 10. Test results are presented in two preliminary reports, one for Franco-Manitoban schools and the present report for French immersion…

This report presents a summary of information about the use in Massachusetts of open-ended questions in the Massachusetts Educational Assessment Program's biennial assessment of mathematics at grades 4, 8, and 12. These questions appeared in one form of the tests in each grade. One-twelfth of the fourth-graders, one-sixteenth of the…

In the spring of 1988, the Massachusetts Department of Education administered its second biennial assessment (the Massachusetts Educational Assessment Program), testing students in grades 4, 8, and 12 in reading, mathematics, science, and social studies. This report discusses the use of open-ended questions in one form of the science tests.…