Attribute hierarchy, the underlying prerequisite relationship among attributes, plays an important role in applying cognitive diagnosis models (CDM) for designing efficient cognitive diagnostic assessments. However, there are limited statistical tools to directly estimate attribute hierarchy from response data. In this study, we proposed a…

Classroom assessment, as a crucial element of the teaching journey, plays a significant part in enhancing student achievement, student learning, and teacher instruction. As such, teachers should possess a good grasp of assessment literacy. This study aimed to explore the EAP teachers' perceptions regarding the demand for in-service training in…

Launched in late November 2022, ChatGPT, a large language model chatbot, has garnered considerable attention. However, ongoing questions remain regarding its capabilities. In this study, ChatGPT was used to complete national high school exams in the Netherlands on the topic of English reading comprehension. In late December 2022, we submitted the…

This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

This paper discusses Texas Examinations of Educator Standards Program Languages Other Than English -- Spanish exam (TExES LOTE - Spanish) and its potential bias, particularly against teacher candidates with Spanish as a heritage language (HL) background. In Texas, most teacher candidates, or college students of Spanish preparing for secondary…

This study reports on the feasibility of using the Test of Complex Syntax- Electronic (TECS-E), as a self-directed app, to measure sentence comprehension in children aged 4 to 5 ½ years old; how testing apps might be adapted for effective independent use; and agreement levels between face-to-face supported computerized and independent computerized…

A growing scholarly literature in a subfield of applied linguistics focuses on language testing and language requirements for migrants. We sought to understand what theoretical paradigms and methodological approaches have framed this research and propose future research directions. To this end, we conducted a systematic review of articles on…

This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

This longitudinal, multi-semester study investigates the Integrated Performance Assessment (IPA) in university-level communicative Spanish classrooms to find out how instructor feedback affects student performance on IPA assessments, if at all, and in what ways do teachers and students use feedback from the IPAs in their teaching and learning, if…

This study is a systematic examination of the open access status of research in two flagship language testing and assessment journals: "Language Testing and Language Assessment Quarterly." Coding and analysing 898 articles, we investigated (a) the prevalence of open access in four aspects--open manuscripts, open materials, open data, and…

This study aims to examine the relationship between vocabulary proficiency and short-term memory capacity in deaf or hard-of-hearing (DHH) children. We test the hypothesis that the relationship between vocabulary skills and digit span performance could be strengthened when the digit span task encompasses cross-modal integration processes. A group…

Background: The abbreviated version of the Token Test (aTT) is widely used to assess language comprehension deficits in stroke patients (SPs). However, aTT has not been validated for Latin American Spanish speakers, so clinicians tend to use cut-off scores for aTT validated in developed countries. Aims: To provide normative data for the Spanish…

While several test concordance tables have been published, the research underpinning such tables has rarely been examined in detail. This study aimed to survey the publically available studies or documentation underpinning the test concordance tables of the providers of four major international language tests, all accepted by the Australian…

This article focuses on rater severity and consistency and their relation to major changes in the rating system in a high-stakes testing context. The study is based on longitudinal data collected from 2009 to 2019 from the second language (L2) Finnish speaking subtest in the National Certificates of Language Proficiency in Finland. We investigated…

This longitudinal study examined how receptive and expressive vocabulary assessments capture vocabulary development in children with Autism Spectrum Disorder (ASD) and typically developing (TD) children. Using mixed regression modelling, we explored when children with ASD significantly different from TD children. We also examined the variability…