A decision of whether to move from paper-and-pencil to computer-based tests is based largely on a careful weighing of the potential benefits of a change against its costs, disadvantages, and challenges. This paper briefly discusses the trade-offs involved in making such a transition, and then focuses on a relatively unexplored benefit of…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…

Single-response situational judgment tests (SRSJTs) differ from multiple-response SJTs (MRSJTS) in that they present test takers with edited critical incidents and simply ask test takers to read over the action described and evaluate it according to its effectiveness. Research comparing the reliability and validity of SRSJTs and MRSJTs is thus far…

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

Disguising scale purpose by using an innocuous skill title and filler items had no effect on the reliability and validity of Rotter's Interpersonal Trust Scale. (Author)

Two studies examined the effect of making the correct answer of a multiple choice test item grammatically consistent with the item. American College Testing Assessment experimental items were constructed to investigate grammatical compliance to investigate grammatical compliance for plural-singular and vowel-consonant agreement. Results suggest…

Indicates that certain items in reading comprehension tests are not measuring for hearing impaired students the particular reading skill they are intended to measure. Argues for a word/idea association strategy as the explanation for this and briefly discusses its relevance for testing and educating the hearing impaired. (FL)

Current issues in the literature on the testing of linguistic and communicative proficiency are reviewed and discussed in relation to reading comprehension testing. Several theoretical issues in language testing are discussed, including testing purposes and test validity. Areas of concern regarding methods of testing reading comprehension are then…

To explain discrepancies in Utah's elementary school test results under the Elementary and Secondary Education Act's Title I Evaluation and Reporting System (TIERS), researchers investigated the adequacy and validity of TIERS evaluation models. Model A (norm-referenced testing) is used in most Utah school districts, in preference to Models B or C…

Eight fifth grade students participated in a study that investigated the effects of test context on test performance and subjects' perceptions of tests in varying contexts. In the first three contexts, reading of words in isolation was tested using materials drawn from three different informal reading inventories equivalent in difficulty level.…

This document summarizes the research on test changes to provide an empirical basis for defining accommodations for students with disabilities. It begins by providing an historical overview of special education accountability. It describes how separate special education accountability systems have evolved and summarizes information on the…