This paper presents a critical evaluation of the English Test for International Communication (ETIC), a large-scale, computer-based, and criterion-referenced English language proficiency test developed by the China Language Assessment in 2016. The ETIC test battery comprises five categories: Basic, Intermediate, Advanced, Superior, and…

This paper highlights as issues of concern the rapid changes in technology and the tendency to report on partial validation efforts where the work is not identified as forming part of a larger validation project. With close human supervision emerging technologies can have a significant and positive impact on language testing. While technology…

The present study explored the comparability in performance scores between the computer-delivered and face-to-face modes for the two speaking tests in the Vietnamese Standardized Test of English Proficiency (VSTEP) (the VSTEP.2 and VSTEP.3-5 Speaking tests) according to Vietnam's Six-Level Foreign Language Proficiency Framework (VNFLPF) and test…

While several studies support the appropriateness of tasks delivered through Spoken Dialog Systems (SDSs) for L2 oral communication assessment, few studies have explored the construct of interactional competence (IC) as measured by such tasks. This study aims to address this gap in the literature by investigating the use of IC features by high-…

With the increased popularity of English-medium instruction (EMI) in higher education, many East Asian universities are using international English proficiency tests to make admissions and placement decisions. Since these tests were not originally designed for the EMI contexts, validity evidence is needed to support the use of these tests in this…

This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

Rater comments tend to be qualitatively analyzed to indicate raters' application of rating scales. This study applied natural language processing (NLP) techniques to quantify meaningful, behavioral information from a corpus of rater comments and triangulated that information with a many-facet Rasch measurement (MFRM) analysis of rater scores. The…

There are few published estimates of vocabulary sizes amongst students in tertiary education. Research does not offer estimates of the vocabulary size tertiary students might be expected to possess, though estimates exist for K-12 education, some EFL contexts, and the general population. Such research is important. For reading comprehension during…

The study investigates whether comprehension of derived words in text context requires a complete understanding of word parts. It explores comprehension of derived words as a function of learner proficiency and contextual clues. Ninety English-as-a-foreign-language learners at three proficiency levels participated in three successive tests…

Phonological processing of written characters has been recognized as a crucial element in acquiring literacy in any language, both native and foreign. This study aimed to assess Japanese primary school students' phoneme-grapheme recognition skills using both paper-based and touch-interface tests. Differences between the two test formats and the…

This study examined the co-occurrence of word reading difficulty in Chinese (L1) and English as a second language (L2) and tested language and executive functioning (EF) skills as correlates. Thirty-nine poor readers in Chinese (PC), 39 poor readers in English (PE), and 26 poor readers of both languages (PB) were compared to 39 average readers who…

Purpose: Children with a developmental language disorder (DLD) are often delayed in their grammatical development. This is suggested to be the most important characteristic and clinical marker of DLD. However, it is unknown if this assumption is valid for young children, in the earliest stages of grammatical development. For this reason, this…

Language complexity reveals the ability to use a wide and varied range of sophisticated structures and vocabulary. Although different languages compose complexity differently, complexity measures such as the T-unit have typically been based on clause subordination, which may underrepresent complexity and threaten the validity of studies. This…

This study explores the extent to which the difficulty levels of grammar items in an English test can be predicted by the complexity of grammatical structures. The researchers carried out two sets of analyses. In the first analysis, the item facility and item discrimination indices of 175 multiple-choice items were examined. In the second…

Second language implicit learning research has shown that a variety of linguistic features can be acquired without awareness. However, this research overwhelmingly uses comprehension tests to measure implicit learning. It remains unclear whether newly acquired implicit knowledge can also be recruited for production. To address this question, we…