The way in which validity has been conceptualized has changed throughout the years. The focus in validation studies shifted from evaluating distinct components of validity to developing a comprehensive argument for the use and interpretations of test scores. The argument-based approach to validity incorporates the distinct types of the…

This study investigated phonological whole-word measures in bilingual Arabic-English speakers to explore how the target approximations influence children's phonological development. To this end, fifteen bilingual Arabic-English speakers and nine monolingual Arabic-speaking children aged 36-48 months (mean = 42) participated in a parent-child…

Educational assessments, from kindergarden to 12th grade (K-12) to licensure, have a long, well-documented history of oppression and marginalization. In this paper, we (the authors) ask the field of educational assessment/measurement to actively disrupt the White supremacist and racist logics that fuel this marginalization and re-orient itself…

This study is a systematic examination of the open access status of research in two flagship language testing and assessment journals: "Language Testing and Language Assessment Quarterly." Coding and analysing 898 articles, we investigated (a) the prevalence of open access in four aspects--open manuscripts, open materials, open data, and…

This study aims to examine the relationship between vocabulary proficiency and short-term memory capacity in deaf or hard-of-hearing (DHH) children. We test the hypothesis that the relationship between vocabulary skills and digit span performance could be strengthened when the digit span task encompasses cross-modal integration processes. A group…

Background: The abbreviated version of the Token Test (aTT) is widely used to assess language comprehension deficits in stroke patients (SPs). However, aTT has not been validated for Latin American Spanish speakers, so clinicians tend to use cut-off scores for aTT validated in developed countries. Aims: To provide normative data for the Spanish…

While several test concordance tables have been published, the research underpinning such tables has rarely been examined in detail. This study aimed to survey the publically available studies or documentation underpinning the test concordance tables of the providers of four major international language tests, all accepted by the Australian…

This article focuses on rater severity and consistency and their relation to major changes in the rating system in a high-stakes testing context. The study is based on longitudinal data collected from 2009 to 2019 from the second language (L2) Finnish speaking subtest in the National Certificates of Language Proficiency in Finland. We investigated…

A frequently encountered security issue in writing tests is nonauthentic text submission: Test takers submit texts that are not their own but rather are copies of texts prepared by someone else. In this report, we propose AutoESD, a human-in-the-loop and automated system to detect nonauthentic texts for a large-scale writing tests, and report its…

This longitudinal study examined how receptive and expressive vocabulary assessments capture vocabulary development in children with Autism Spectrum Disorder (ASD) and typically developing (TD) children. Using mixed regression modelling, we explored when children with ASD significantly different from TD children. We also examined the variability…

It is important for college students and future TESOL teachers to see someone like them among their instructors and mentors. Diverse future teachers who are trained in TESOL might be attracted to the profession based on who their teacher educators are in terms of gender, multilingualism, international studies, and/or work experience. The question…

As applied linguists and language testers, we are in the business of "doing language". For many of us, language learning is a lifelong passion, and we invest similar enthusiasm in our language assessment research and testing practices. Language is also the vehicle through which we communicate that enthusiasm to others, sharing our…

Cognitive diagnostic assessment is known for its capacity to provide detailed feedback to test-takers, which can inform instruction and guide learning. Besides this core strength of the assessment approach, the measurement procedure also works as a construct validation method in itself. Previous studies do not call attention to this aspect of…

Test preparation has garnered considerable attention in second language (L2) education due to the significant implications that successful performance on a language test may have for academic advancement, future career opportunities, and immigration prospects. Meanwhile, an overemphasis on test preparation has been criticized for encouraging the…

This article provides a review of research in applied linguistics published in Australia in the period 2015-2022. Primarily, it is based on articles from Australian publications as material from other sources is more widely available to an international audience. The research has been published in such journals as the "Australian Journal of…