In order to ensure content validity by covering a broad range of content domains, the testing times of some educational large-scale assessments last up to a total of two hours or more. Performance decline over the course of taking the test has been extensively documented in the literature. It can occur due to increases in the numbers of: (a)…

In previous studies, problem solving appraisal has been identified as playing a key role in promoting positive psychological well-being. The Problem Solving Inventory is the most widely used measure of problem solving appraisal and consists of 32 items. The length of the instrument, however, may limit its applicability to large-scale surveys…

When cognitive and educational tests are administered under time limits, tests may become speeded and this may affect the reliability and validity of the resulting test scores. Prior research has shown that time limits may create or enlarge gender gaps in cognitive and academic testing. On average, women complete fewer items than men when a test…

This study aimed to investigate the test-taking strategies needed for successful completion of a lecture-based listening test by employing self-reported test-taking strategy use, actual strategy use measured via eye-tracking, and test scores. In this study, participants' gaze behavior (measured by fixation and visit duration and frequency) were…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…

Recently, research in second language acquisition has seen an increased attention on low-educated low-literate (LESLLA) learners. However, few of the existing instruments to measure L2 proficiency have been validated for use with this population. In this paper, we examine how adult L2 learners with diverging educational backgrounds perform on and…

This article investigates how test-takers change their strategies to handle increased test difficulty. An adult sample reported their test-taking strategies immediately after completing the tasks in a reading test. Data were analyzed using structural equation modeling specifying a measurement-invariant, ability-moderated, latent transition…

This article explores an approach for test score validation that examines test takers' strategies for taking a reading comprehension test. The authors formulated three working hypotheses about score validity pertaining to three types of test-taking strategy (comprehending meaning, test management, and test-wiseness). These hypotheses were…

Emotional intelligence is increasingly recognized as being important for professional career success. Skills related to emotional intelligence (e.g. organizational commitment, public speaking, teamwork, and leadership) are considered essential. Human resource professionals have begun including tests of emotional intelligence (EI) in job applicant…

This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…

An achievement test score can be viewed as a joint function of skill and will, of knowledge and motivation. However, when interpreting and using test scores, the "will" part is not always acknowledged and scores are mostly interpreted and used as pure measures of student knowledge. This paper argues that students' motivation to do their…

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

Purpose: The purpose of this paper is to present a case study of City & Guilds' development of simulation-based assessments for its ICT user qualification. These simulations are authentic scenario-based replicas of word processing and spreadsheet software, which present a series of tasks that the test-taker completes as if they were using…

Traces student comprehension in beginning economics course examinations in the United Kingdom from 1969 to 1973. Demonstrates that males performed better on multiple-choice tests, females performed better on essay examinations, and that female learning rates were lower than male learning rates. Reviews the influence of precollege courses. Includes…

The usefulness of studying thought processes in the construct validation of ability tests was examined using a sample consisting of 343 Canadian senior high school students. Four levels of probing were used by the interviewer to examine the students' thinking processes while taking the Test on Appraising Observations: (1) think aloud; (2)…