The measurement of test-taking strategies and practices, mostly studied through qualitative methods, has been an important aspect of language testing and assessment research. The current study examines the test-taking strategies of International English Language Testing System (IELTS) test-takers and reports the process of designing and validating…

The present study is part of a larger mixed methods project that investigated the speaking section of the Advanced Placement (AP) Japanese Language and Culture Exam. It investigated assumptions for the evaluation inference through a content analysis of test taker responses. Results of the content analysis were integrated with those of a many-facet…

Educators, especially test creators, are concerned with the construct validity of their tests. Blame has generally been attached to test-wiseness strategies as one source of error in measurement. There is little evidence of any relation between test-taking strategies in general and test validity; thus, it is not known how strategies can affect…

Recently, research in second language acquisition has seen an increased attention on low-educated low-literate (LESLLA) learners. However, few of the existing instruments to measure L2 proficiency have been validated for use with this population. In this paper, we examine how adult L2 learners with diverging educational backgrounds perform on and…

Research examining test taker fluency in simulated and face-to-face oral proficiency interview performances has primarily focused on quantitative spoken utterance fluency data alone, with further qualitative investigation of test taker processing fluency's effect being neglected. This study compared four test takers' spoken utterance and…

The central purpose of this paper is to examine validity problems arising from the multiple-choice items and technical passages in the Test of English as a Foreign Language Internet-based Test (TOEFL iBT) reading section, primarily concentrating on construct-irrelevant variance (Messick, 1989). My personal TOEFL iBT experience, along with my…

For test scores that rely on the accurate estimation of ability via an IRT model, their use and interpretation is dependent upon the assumption that the IRT model fits the data. Examinees who do not put forth full effort in answering test questions, have prior knowledge of test content, or do not approach a test with the intent of answering…

In most large-scale programs of tests that aid in making high-stakes decisions, such as the "TOEIC"® family of products and service, it is not unusual for a significant portion of test takers to retake the test at multiple times.The study reported here used multilevel growth modeling to explore the score change patterns of nearly 20,000…

This article reports an empirical study that examined the pattern of test preparation for College English Test Band 4 (CET4) and the differential effects of test preparation practices on its scores, thereby drawing implications for CET4 score validity. Data collection involved 1,003 test takers of CET4. A pretest was administered at the beginning…

Test-takers' interpretations of validity as related to test constructs and test use have been widely debated in large-scale language assessment. This study contributes further evidence to this debate by examining 59 test-takers' perspectives in writing large-scale English language tests. Participants wrote about their test-taking experiences in…

Language testing research has recently witnessed an increased interest in test-wiseness strategies and test-taking strategies used by test-takers in responding to test tasks. Although these strategies are extensively studied in L1 literature, they are noticeably neglected in EFL/ESL testing literature. The purpose of this article is to: a)…

This article advocates making the provision of opportunities for learning the main objective of language testing. It recognizes the need for tests to be fair, valid, and reliable, but asserts the priority of what it calls "learning validity", in order to prevent time being wasted on language courses on tests, and the preparation for them. The…

The design of a valid and reliable test of test-wiseness is reported: a 33-item multiple-choice instrument with 4 subscales trialed with several groups of English-as-a-Second-Language students. Findings indicate differential skills in test-taking; some learner scores are influenced by skills that are not the focus of the test. (13 references)…

Current issues in the literature on the testing of linguistic and communicative proficiency are reviewed and discussed in relation to reading comprehension testing. Several theoretical issues in language testing are discussed, including testing purposes and test validity. Areas of concern regarding methods of testing reading comprehension are then…

The survey of foreign language testing described in this paper resulted in the issuing of three handbooks and a special validation report, encompassing the results of research, consultation with professional committees, and significant position statements in four major areas of foreign language testing: placement of incoming students in foreign…