The present study used process data from a computer-based problem-solving task as indications of behavioural level of test-taking effort, and explored how behavioural item-level effort related to overall test performance and self-reported effort. Variables were extracted from raw process data and clustered. Four distinct clusters were obtained and…

Differential item functioning (DIF) for an item between two groups is present if, for the same person location on a variable, persons from different groups have different expected values for their responses. Applying only to dichotomously scored items in the popular Mantel-Haenszel (MH) method for detecting DIF in which persons are classified by…

This article promotes the use of modern test theory in testing situations where sum scores for binary responses are now used. It directly compares the efficiencies and biases of classical and modern test analyses and finds an improvement in the root mean squared error of ability estimates of about 5% for two designed multiple-choice tests and…

Over time international large-scale assessments have grown in terms of number of studies, cycles, and participating countries, many of which are a heterogeneous mix of economies, languages, cultures, and geography. This heterogeneity has meaningful consequences for comparably measuring both achievement and non-achievement constructs, such as…

We investigated time-related patterns in levels of cognitive performance during the period from 1970 to 1993 based on data from Swedish draft boards. The conscripts, including more than a million 18-19-year old men, had taken one of two versions of the Swedish enlistment battery (SEB67; 1970-1979 or SEB80; 1980-1993), each composed of four…

The International Adult Literacy Survey (IALS) was conducted in 1994 in seven European countries with the aim of producing literacy profiles to be used in individual national analyses as well as in international comparisons. It was assumed that the test items could be divided into three unidimensional scales corresponding to the aspects…