The purpose of this study is to review the status of differential item functioning (DIF) research in language testing, particularly as it relates to the investigation of sources (or causes) of DIF, which is a defining characteristic of the third generation DIF. This review included 110 DIF studies of language tests dated from 1985 to 2019. We…

In sociolinguistic contexts where standardized languages coexist with regional dialects, the study of differential item functioning is a valuable tool for examining certain linguistic uses or varieties as threats to score validity. From an ecological perspective, this paper describes three stages in the study of differential item functioning…

In language assessment, AI technology has been incorporated in task design, assessment delivery, automated scoring of performance-based tasks, score reporting, and provision of feedback. AI technology is also used for collecting and analyzing performance data in language assessment validation. Research has been conducted to investigate the…

This paper explores what the measures of utterance fluency typically employed in Automatic Speech Evaluation (ASE), i.e. automated speaking assessments, tell us about oral proficiency. 60 Chinese learners of English completed the second part of the speaking section of IELTS and six tasks designed to measure the linguistic knowledge and processing…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

This paper highlights as issues of concern the rapid changes in technology and the tendency to report on partial validation efforts where the work is not identified as forming part of a larger validation project. With close human supervision emerging technologies can have a significant and positive impact on language testing. While technology…

While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

There is a lack of tests available for assessing sign language proficiency among L2 learners. We have therefore developed a sign repetition test, SignRepL2, with a specific focus on the phonological features of signs. This paper describes the two phases of developing this test. In the first phase, content was developed in the form of 50 items with…

This paper examines (1) teacher candidates' knowledge of recent migration trends and language accreditation policies, (2) their attitudes towards language testing for migration, and (3) changes in their perceptions after exposure to training and migrant testimonies. Conducted over two years (2021-2023), this mixed-methods study involved 395…

Many English-medium universities employ a compensatory model to establish cutscores on English language proficiency tests for student admissions. In this model, students can have different scores on different sections of the test provided their overall score meets the admission cutscore. This practice raises questions regarding potential variation…

While scholars have proposed different models of language assessment literacy (LAL), these models have mostly comprised prescribed sets of components based on principles of good practice. As such, these models remain theoretical in nature, and represent the perspectives of language assessment researchers rather than stakeholders themselves. The…

This replication study sought to compare the academic achievement of undergraduate students with different score profiles on the TOEFL iBT. Two-step cluster analysis of TOEFL iBT section scores identified six clusters among 2,347 undergraduate students who met the required cutscore on the TOEFL iBT for admission to a Canadian English-medium…

To date, language testing research has devoted little attention to adult L2 learners with low levels of alphabetic print literacy (LESLLA), even though this population makes up for a substantial proportion of the candidature of language tests used for migration purposes. This special issue focuses on LESLLA learners, shows how literacy impacts…

This paper constitutes an edited transcript of two online panels, conducted with four scholars whose complementary expertise regarding print literacy and migration offers a thought-provoking and innovative window on the representation of print literacy in applied linguistic research and in migration policy. The panel members are experts on…

This study tracked the development of Hong Kong's assessment practices for English pronunciation over the past four decades, with reference to the nativeness and intelligibility principles in L2 pronunciation research and pedagogy. Specifically, it evaluated changes in assessors' comments on candidates' English pronunciation performance in…