Studies have documented the significance of scaffolding as a sociocultural theory driven type of assistance for the development of English as foreign language (EFL) learners' language skills in general; however, the comparative efficacy of various cognitive and/or metacognitive scaffolding procedures for EFL learners' listening comprehension…

In second language listening assessment and pedagogy, practitioners hold different views on whether to repeat a listening text in contexts where inferences about listening ability are to be drawn from task performance. To address this issue, we investigated the effects of repeating the listening text (double play) on listener performance,…

Launched in late November 2022, ChatGPT, a large language model chatbot, has garnered considerable attention. However, ongoing questions remain regarding its capabilities. In this study, ChatGPT was used to complete national high school exams in the Netherlands on the topic of English reading comprehension. In late December 2022, we submitted the…

This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

Background: The abbreviated version of the Token Test (aTT) is widely used to assess language comprehension deficits in stroke patients (SPs). However, aTT has not been validated for Latin American Spanish speakers, so clinicians tend to use cut-off scores for aTT validated in developed countries. Aims: To provide normative data for the Spanish…

This paper evaluates the multistage adaptive test (MST) design of a large-scale academic language assessment (ACCESS) for Grades 1-12, with an aim to simplify the current MST design, using both operational and simulated test data. Study 1 explored the operational population data (1,456,287 test-takers) of the listening and reading tests of MST…

In sociolinguistic contexts where standardized languages coexist with regional dialects, the study of differential item functioning is a valuable tool for examining certain linguistic uses or varieties as threats to score validity. From an ecological perspective, this paper describes three stages in the study of differential item functioning…

Purpose: This study focuses on 7- to 9-year-old children attending primary school in Swedish areas of low socioeconomic status, where most children's school language is their second language. The aim was to better understand what factors influence these children's narrative listening comprehension both in an ideal listening condition (in quiet)…

This study aimed to answer an ongoing validity question related to the use of nonstandard English accents in international tests of English proficiency and associated issues of test fairness. More specifically, we examined (1) the extent to which different or shared English accents had an impact on listeners' performances on the Duolingo listening…

The current study used principles of high-quality measurement design including domain specification, item generation, expert review, and piloting to develop two versions of a morphological awareness measure to be administered to 63 primarily English-speaking second grade students: the "Static Morphological Awareness Assessment (StMA)"…

The study investigates whether comprehension of derived words in text context requires a complete understanding of word parts. It explores comprehension of derived words as a function of learner proficiency and contextual clues. Ninety English-as-a-foreign-language learners at three proficiency levels participated in three successive tests…

This study investigates the evolution of reading comprehension abilities in Indonesian learners of the Chinese Heritage Language (CHL), by comparing their scores on the Chinese Proficiency Test, a test specifically designed for CHL learners. A total of 275 candidates, divided into early adolescent (M[subscript age] = 13.56), late adolescent…

Many studies have shown that morphological knowledge has effects on reading comprehension separate from other aspects of language knowledge. This has implications for reading instruction and assessment: it suggests that children could have reading comprehension difficulties that are due to a lack of morphological knowledge, and thus, that explicit…

Analysis of conversations between international university students in the Corpus of English as a Lingua Franca Interaction (CELFI, McDonough & Trofimovich, 2019) has demonstrated that holds, which are temporary cessations of dynamic movement, are a robust visual cue of nonunderstanding that can be reliably interpreted by external observers as…

This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…