A decision of whether to move from paper-and-pencil to computer-based tests is based largely on a careful weighing of the potential benefits of a change against its costs, disadvantages, and challenges. This paper briefly discusses the trade-offs involved in making such a transition, and then focuses on a relatively unexplored benefit of…

There has been increasing concern about the presence of disengaged test taking in international assessment programmes and its implications for the validity of inferences made regarding a country's level of educational attainment. This issue has received a growing research interest over the past 20 years, with notable advances in both the…

Introduction: This study evaluated performance and engagement on the tactile science alternate assessment based on alternate academic standards (AA-AAS). This assessment was designed for students with significant intellectual disabilities and visual impairments (i.e., blindness and low vision). Four primary research questions guided this study.…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

In 2015, all Australian education ministers agreed that from 1 July 2016 the Government would initiate the Literacy and Numeracy Test for Initial Teacher Education (LANTITE), designed to verify that all prospective teachers could demonstrate the literacy and numeracy skills required in their profession. The LANTITE quickly became another hurdle…

The functioning of a vocabulary testing instrument rests in part on the test-taking actions made possible for examinees by item format, an aspect of test development that warrants consideration in second-language vocabulary research. For example, although iterations of the written receptive vocabulary levels test (VLT) have integrated improvements…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…

Making the transition from university to employment is a challenging process for many students. One common method used by recruiters to sift through graduate applications is the use of psychometric tests which typically consist of numerical and verbal reasoning tasks. To explore how frequently these tests are used by graduate employers, an audit…

As part of continued efforts to ensure inclusivity in assessment, OCR has developed a set of accessibility principles for question design in GCSE Science examinations, which has been applied since 2018. The principles are intended to help ensure that all students can demonstrate their knowledge, understanding and skills to the best of their…

A vast literature investigates academic disengagement among students, including its ultimate manifestation, dropping out of school. Research also shows that test disengagement can be a problem for many inferences educators and policymakers wish to draw from test scores. However, few studies consider whether academic and test disengagement are…

The present study is part of a larger mixed methods project that investigated the speaking section of the Advanced Placement (AP) Japanese Language and Culture Exam. It investigated assumptions for the evaluation inference through a content analysis of test taker responses. Results of the content analysis were integrated with those of a many-facet…

Test-taking motivation (TTM) has been associated with test performance in low-stakes testing contexts. However, there have been few studies about TTM in high-stakes testing contexts, and these have contradictory results. Our aim was to explore the relationship between test-taking effort and test performance in a real-life high-stakes testing…

Students in a gateway college science course were assigned to two instructional conditions: explanation-only or augmented instruction. In the explanation-only condition, students wrote explanations for six excerpts from their textbook. The augmented-instruction condition wrote explanations on only four of the excerpts, with the other two serving…

The purpose of this study was to evaluate the effectiveness of linking test scores by using test takers' background data to form pseudo-equivalent groups (PEG) of test takers. Using 4 operational test forms that each included 100 items and were taken by more than 30,000 test takers, we created 2 half-length research forms that had either 20…

Learning from expository science texts is challenging. These studies explore whether difficulties can be attributed to poor memory or poor reasoning. To eliminate the need for memory during testing, some students took the tests with the texts available. To test for the effects of reasoning on performance, some students were prompted to engage in…