To examine the effects of listening test preparation, we had three groups, two experimental and one control (63 learners total), partake in three types of instruction sandwiched between two equally difficult listening tests (pretests and posttests). The first experimental group took four practice tests and received "explicit"…

Dynamic Assessment (DA) has received a considerable amount of attention in the educational sciences and beyond. DA combines instruction or feedback with assessment or testing within a single activity. DA has great potential for classroom practices, but has not been implemented in many classrooms yet. In this article, we argue that teacher…

Fifteen years after its publication, the Common European Framework of Reference for Languages is a commonly used document in language tests and policies across Europe. This article considers the CEFR's impact on university entrance language tests and policies that are used to regulate the entrance of international L2 students who wish to study in…

Because English is widely used as a lingua franca, language testers have started to consider the introduction of non-native accents into English listening tests. This study investigates how accents influence test-takers' performance, and also elicits test-takers' subjective perception of accents. Eighty adolescent L1-Mandarin test takers were…

This research explores how Internet-based video-conferencing technology can be used to deliver and conduct a speaking test, and what similarities and differences can be discerned between the standard and computer-mediated face-to-face modes. The context of the study is a high-stakes speaking test, and the motivation for the research is the need…

This study has two research purposes related to L2 writing development. The first aim of this study is to explore how L2 learners receiving intensive ESL instruction develop their writing proficiency (writing quality from an analytic rubric) across two writing tasks (narrative and argumentative writing) over one semester. Limiting its focus to…

Common estimators of interrater reliability include Pearson product-moment correlation coefficients, Spearman rank-order correlations, and the generalizability coefficient. The purpose of this study was to examine the accuracy of estimators of interrater reliability when varying the true reliability, number of scale categories, and number of…

This small-scale qualitative study considers feedback and results reported for two major large-scale English language tests administered in Japan: the Global Test of English Communication for Students (GTECfS) and the Eiken Test in Practical English Proficiency (Eiken). Specifically, it examines current score-reporting practices in student and…

The conceptualization of language assessment literacy (LAL) is currently a subject of debate in the language testing community, especially with regard to the role language components play in this construct. This is part of a broader discussion of generic and discipline-specific assessment literacy. Previous research on language teachers' LAL aimed…

The number of public school students who are English learners (ELs) has been increasing steadily in the United States. According to a report by Snyder, de Brey, and Dillow (2016), in the 2014-2015 school year, nearly 4.6 million students enrolled in Kindergarten through grade 12 (K-12) in U.S. schools were English learners, representing…

In language testing programs, different test forms are often used to administer the same test. Demonstrating the comparability of these forms is essential to avoid criticisms of potential test unfairness. However, studies with this objective are scarce. This study aims to investigate the extent to which the picture-prompt writing tasks of three…

In vocabulary research there has been a shift from focusing on single words to considering multiword sequences, such as collocations. Despite the general consensus among language researchers that collocation is essential to effective language use in real-world communication, particularly oral communication, language-testing researchers have made…

Despite the frequent occurrence of yes/no questions in naturalistic talk-in-interaction, there is widespread concern that yes/no questions only allow predetermined answers and limit L2 learners' performance in language assessment contexts. Drawing upon audio-recordings of role-play conversations between an L1 American English speaker and 104 L2…

This article discusses a range of current issues and future research possibilities in Communicative Language Testing (CLT) using, as its departure point, the key questions which emerged during the CLT symposium at the 2010 Language Testing Forum. The article begins with a summary of the 2010 symposium discussion in which three main issues related…

Despite the wide use of language tests as a basis for awarding English language course credits at Japanese universities, little has been published about how universities set policies on awarding credits according to external test scores. To narrow this gap, the characteristics of such policies were investigated in relation to the EIKEN Test in…