Common response-time-based approaches for non-effortful response behavior (NRB) in educational achievement tests filter responses that are associated with response times below some threshold. These approaches are, however, limited in that they require a binary decision on whether a response is classified as stemming from NRB; thus ignoring…

The process of quantification is a powerful development shaping many domains of life today. In the area of education, for example, performance measurement, testing and ranking have become common tools of governance. Quantification is not a neutral way of describing society, but a process of valorisation. It has three sociologically relevant…

This article examines whether the way that PISA models item outcomes in mathematics affects the validity of its country rankings. As an alternative to PISA methodology, a two-parameter logistic model is applied to PISA mathematics item data from Italy and Spain for the year 2009. In the estimation procedure, item difficulty and dispersion…

The Program for International Student Assessment Young Adult Follow-up Study (PISA YAFS) is a follow-up study with students who participated in PISA 2012 in the United States. The study is designed to measure how performance on PISA 2012 relates to subsequent measures of outcomes and skills of young adults on an online assessment, Education and…

Purpose: The purpose of this paper is to develop a framework for reconceptualising research on school autonomy to redress the limitations of traditional research, strengthen the conceptual links between school autonomy and learning outcomes and offer a range of new strategies for studying the interplay of school autonomy, leadership and learning.…

The aim of this paper is to discuss the role of coding and observation manuals in classroom studies. While observation manuals have been a part of the methodological toolkit for measuring various aspects of instruction for decades, the field has also been suffering from "paradigm wars," fragmentation and local production of instruments.…

This paper reflects on the methodology used in international comparative education surveys by conducting a systematic review of the European Survey on Language Competences (ESLC). The ESLC was administered from February to March 2011, with final results released in June 2012. The survey tested approximately 55,000 students across 14 European…

The Programme for International Student Assessment (PISA) is an important cross-national study of 15-year-olds' academic knowledge and skills. Educationalists and public policymakers eagerly await the tri-annual results, with particular interest in whether their country has moved up or slid down the international rankings, as compared to earlier…

The development of mathematical literacy in schools is of significant concern at the policy level, and research is an important source of information in this process. This review article focuses on areas of research interest identified in empirical projects on mathematical literacy, and how mathematical literacy in schools is approached by…

In the current article, we consider the influential position of the Programme for International Student Assessment (PISA) and discuss several methodological areas that demonstrate the need for caution when using and interpreting PISA results. We motivate our argument by briefly describing the program's increased influence in educational policy…

Trying to understand PISA is analogous to the parable of the blind men and the elephant. There are many facets of the PISA program, and thus many ways to both applaud and critique this ambitious international program of assessment that has gained enormous importance in the crafting of contemporary educational policy. One of the facets discussed in…

The results of large-scale international assessments such as Programme for International Student Assessment (PISA) have attracted a considerable attention worldwide and are often used by policy-makers to support educational policies. To ensure that the published results represent the actual population, these surveys go through a thorough scrutiny…

IES is the primary research, evaluation, and statistics arm of the U.S. Department of Education. Established through the Education Sciences Reform Act of 2002 (ESRA), the Institute's mission is to expand fundamental knowledge and understanding of education and to provide education leaders and practitioners, parents and students, researchers, and…

The article argues that science assessment should change from an item-driven to a construct-driven practice and pay more attention to disciplinary scientific reasoning. It investigates assessment scales developed from a novel theoretical rationale, describing scientific reasoning as three fundamental practices (hypothesizing, experimenting, and…

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…