As testing programs transition from paper to online testing, they must study mode comparability to support the exchangeability of scores from different testing modes. To that end, a series of three mode comparability studies was conducted during the 2019-2020 academic year with examinees randomly assigned to take the ACT college admissions exam on…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

This study investigated the effects of two different planning time conditions (i.e., operational [20 s] and extended length [90 s]) for the lecture listening-into-speaking tasks of the "TOEFL iBT"® test for candidates at different proficiency levels. Seventy international students based in universities and language schools in the United…

This article examines the test-taking strategies of high- and low-scoring Chinese-speaking participants when they answer English multiple-choice reading comprehension questions. Thirty-two participants took a TOEIC reading test, provided think-aloud protocols, and joined a post-task interview. The data come primarily from qualitative analysis and…

For test scores that rely on the accurate estimation of ability via an IRT model, their use and interpretation is dependent upon the assumption that the IRT model fits the data. Examinees who do not put forth full effort in answering test questions, have prior knowledge of test content, or do not approach a test with the intent of answering…

The investigation of test-taking strategies is a crucial aspect of test validation studies especially if the test is a high-stakes one. The purpose of this study was to uncover if gender, academic discipline and the total exam score influence on the test-taking strategies employed by the candidates of the General English Section of the National…

The Ordinary National Educational Test (O-NET), the national examination in Thailand, plays as a high-stakes test at an upper secondary school level as it can be used as a tool for several purposes in education such as gatekeepers for the university entry and measures for the teaching quality evaluation. English, out of the five core subjects in…

The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of…

Considerable evidence indicates that self-efficacy, task value, anxiety, and the use of language learning strategies are related. However, there is currently an insufficient understanding about their relations in high-stakes testing contexts. The author aimed to investigate how well social factors, test value, anxiety, test performance, and…

The use of computer-based assessments makes the collection of detailed data that capture examinees' progress in the tests and time spent on individual actions possible. This article presents a study using process and timing data to aid understanding of an international language assessment and the examinees. Issues regarding test-taking strategies,…

In most large-scale programs of tests that aid in making high-stakes decisions, such as the "TOEIC"® family of products and service, it is not unusual for a significant portion of test takers to retake the test at multiple times.The study reported here used multilevel growth modeling to explore the score change patterns of nearly 20,000…

This replication study investigates how the level of context in vocabulary assessment affects the scores on tests of American idioms. Using Uçkun's methodology of 3 tests with 3 levels of context, 85 participants varying in level from high-beginner to advanced took an online test consisting of 30 questions, 10 questions for each level of context.…

This study sought to explore the perspectives of learners involved in the IELTS Academic Writing Module courses. In particular, the study explored learner perspectives of motivation, test-taking anxiety, test-taking strategies, and the expectations students bring to their courses. This study adopted a mixed methodology and collected data through…

This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…

This study investigates the relationship between test preparation and test performance on the "TOEFL iBT"® exam. Information on background variables and test preparation strategies was gathered from 14,593 respondents in China through an online survey. A Chinese standardized English test was used as a control for prior English ability.…