This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

The way in which validity has been conceptualized has changed throughout the years. The focus in validation studies shifted from evaluating distinct components of validity to developing a comprehensive argument for the use and interpretations of test scores. The argument-based approach to validity incorporates the distinct types of the…

Test preparation has garnered considerable attention in second language (L2) education due to the significant implications that successful performance on a language test may have for academic advancement, future career opportunities, and immigration prospects. Meanwhile, an overemphasis on test preparation has been criticized for encouraging the…

This study delves into writing scores in both tests, aiming to uncover the reasons behind score differences. Through comprehensive comparative analysis, this research explores scoring patterns, criteria, and score distributions in IELTS and PTE writing sections. It investigates sources of score variation, including task design, rating criteria,…

Plurilingual competence or repertoire of languages refers to all individuals being potentially plurilingual. As plurilingual competence and language repertoires are individual, assessment modes targeted to the individual and localized to the context should be encouraged. This study explored and depicted the plurilingual profile of Italian Studies…

Vocabulary knowledge plays an important role in language learning and language proficiency, but it is difficult to know how much of a role it plays without appropriate vocabulary measures. In this article, we first discuss learner vocabulary in our research on Korean as a second/foreign language. Unable to find appropriate measures for receptive…

Stakeholders in exam-driven countries are responsible for developing test-related tasks to assess the quality of English as a Foreign Language (EFL) teaching and learning. Hence, the language assessment literacy (LAL) of different stakeholders has to be investigated. This mixed-methods study explored the required LAL competencies among two groups…

A large number of children are exposed to more than one language. One well-established method of assessing early vocabulary development in monolingual children is parent report; however, its use in bilingual/multilingual contexts is less established and brings unique challenges. In this methodological scoping review, we reviewed studies of early…

J.D. Brown (JD) served as the author of an instructional column titled "Statistics Corner" in the "Shiken": JALT "Testing & Evaluation SIG Newsletter" for an extensive period spanning over two decades, from 1997 to 2019. This publication was under the auspices of the Testing and Evaluation Special Interest Group,…

Aural lexical knowledge (ALK) is crucial for second language (L2) listening. Despite its importance, there is scant research that has validly explored the relationship between ALK and L2 listening across different English as a Foreign Language (EFL) contexts. In an effort to broaden this research base, the current study closely replicates a…

This study investigated how questioning strategies impact language learner performance. Specifically, it explored how questioning strategies influence (i) verb production and subject-verb agreement in the target language, and (ii) learner confidence in completing tasks without translation software. Sixty-eight novice language learners enrolled in…

In order to address the needs of the continually growing number of Chinese language learners, the present study developed and presented initial validation of a 100-item Chinese vocabulary proficiency test (CVPT) for learners of Chinese as a second/foreign language (CS/FL) using Item Response Theory among 170 CS/FL learners from Indonesia and 354…

Chinese learners of English often experience difficulty with English tense presumably because their native language is tenseless. We showed that this difficulty relates to their incomplete conceptual representations for tense rather than their poor grammatical rule knowledge. Participants made acceptability judgments on sentences describing…

Multimedia glosses have been examined extensively by researchers for over three decades to determine their possible effects in second language (L2) vocabulary acquisition. Many meta-analytic studies aimed to determine the extent to which glosses can impact L2 vocabulary learning and the moderators that can mediate the results of meta-analytic…

Rating scales that language testers design should be tailored to the specific test purpose and score use as well as reflect the target construct. Researchers have long argued for the value of data-driven scales for classroom performance assessment, because they are specific to pedagogical tasks and objectives, have rich descriptors to offer useful…