Purpose: Recent research on the potential of using eye-tracking to measure reading comprehension ability suggests that the relationship between standard eye-tracking measures and reading comprehension is influenced by differences in task demands between comprehension assessments. We compared standard eye-tracking measures and scanpath regularity…

The Mantel-Haenszel estimator is one of the most popular techniques for measuring differential item functioning (DIF). A generalization of this estimator is applied to the context of DIF to compare items by taking the covariance of odds ratio estimators between dependent items into account. Unlike the Item Response Theory, the method does not rely…

Student well-being has emerged as a topic of considerable interest to researchers and educators. Recent work has sought to examine relationships between measures of student well-being and other constructs such as academic achievement, physical health, relationships with peers, and engagement in learning. Reading assessment and context…

This study investigates consistent and inconsistent respondents to mixed-worded questionnaire scales in large-scale assessments. Mixed-worded scales contain both positively and negatively worded items and are universally applied in different survey and content areas. Due to the changing wording, these scales require a more careful reading and…

It is well-documented that academic achievement is associated with students' self-perceptions of their academic abilities, that is, their academic self-concepts. However, low-achieving students may apply self-protective strategies to maintain a favorable academic self-concept when evaluating their academic abilities. Consequently, the relation…

Progress in International Reading Literacy Study (PIRLS) is a large-scale comparison of the reading performance of Year 4 students in 50 countries, and Year 4 was chosen because it is the point in schooling where most students transition from 'learning to read' to 'reading to learn'. As the essential nature of their relationship with reading…

Australia and New Zealand have participated in the Organisation for Economic Co-operation and Development's Programme for International Student Assessment since 2000. Reading literacy was the main focus of the Programme for International Student Assessment in 2000, and at that time both countries' students generally performed well above the…

Approximately a third of the Programme for International Student Assessment (PISA) items in the core domains (math, reading, and science) are constructed-response items and require human coding (scoring). This process is time-consuming, expensive, and prone to error as often (a) humans code inconsistently, and (b) coding reliability in…

PIRLS (Progress in International Reading Literacy Study) is the fourth assessment in the current trend series, following PIRLS 2001, 2006, and 2011. There were 61 participants in PIRLS 2016, including 50 countries and 11 benchmarking entities (e.g., regions of countries as well as additional grades or language groups from the participating…

Australia has declared its ambition to be within the "top five" in the Programme for International Student Assessment (PISA) by 2025. So serious is it about this ambition, that the Australian Government has incorporated it into the "Australian Education Act, 2013". Given this focus on PISA results and rankings, we go beyond…

The International Association for the Evaluation of Educational Achievement's (IEA's) Progress in International Reading Literacy Study (PIRLS) 2011 provided evidence which showed differences in the reading achievement of students who spoke the language of assessment at home and those who did not for many countries including a selection of the…

"Methods and Procedures in PIRLS 2016" documents the development of the Progress in International Reading Literacy Study (PIRLS) assessments and questionnaires and describes the methods used in sampling, translation verification, data collection, database construction, and the construction of the achievement and context questionnaire…

Background: Large-scale cross-national studies designed to measure student achievement use different social, cultural, economic and other background variables to explain observed differences in that achievement. Prior to their inclusion into a prediction model, these variables are commonly scaled into latent background indices. To allow…

Background: The present study investigates what factors related to the school context influence student achievement on TIMSS mathematics tests across countries. A systematic review of the literature on PIRLS, TIMSS, and ICCS was conducted upstream to identify those school, teacher, and classroom factors shown to be useful predictors of student…

This report supplements Jerrim (2012) where John Jerrim investigated the link between family background and children's reading tests across a series of Organisation for Economic Co-operation and Development (OECD) countries. Previous studies for the Sutton Trust (Smithers 2012) have suggested that policy and provision for the highly able in…