This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

Various stakeholders, such as policymakers and educators, require diagnostic feedback and actionable test results. One particular context in which fine-grained test results are of utmost importance is English language proficiency (ELP) assessments as they are used for critical decisions for students. Diagnostic classification models (DCMs) afford…

Given the significant global influence of the Common European Framework of Reference for Languages: Teaching, Learning, and Assessment (CEFR) on English language education, this study deals with aligning a university's academic reading tests to the CEFR. It aimed at validating the test construct of the academic reading tests in relation to the…

Research on the use of standardized test scores in higher education reveals significant variations in attitudes and perceptions of language proficiency tests among test score users. Most test score users have limited knowledge about test score interpretations in terms of what English as additional language (EAL) students typically know and can do…

Research involving digital games and language learning is rapidly growing. One advantage of using digital games to support language learning is the ability to collect data on students learning in real time. In this study, we use educational data mining methods to explore the relationship between in-game data and elementary students' Chinese…

Purpose: This study investigated the reading profiles of middle school Spanish-speaking emergent bilinguals (EBs) with significantly below grade level reading comprehension and whether these profiles varied in their reading comprehension performance over time. Method: Latent profile analyses were used to classify Grade 6 and 7 Hispanic EBs (n =…

Metacognitive awareness is considered a crucial factor in reading comprehension. In the present study, the quantitative research method was applied using descriptive statistics, T-test, and ANOVA to identify: (1) What is second language (L2) Vietnamese students' metacognitive awareness of reading strategies? (2) Are there any significant…

The Hierarchical Diagnostic Classification Model (HDCM) reflects on the sequences of the presentation of the essential materials and attributes to answer the items of a test correctly. In this study, a foreign language reading comprehension test was analyzed employing HDCM and the generalized deterministic-input, noisy and gate (G-DINA) model to…

Although the benefits of extensive reading are well known, very little research has investigated the validity of assessment tools to measure general comprehension of graded readers. To address this, quizzes were authored for 42 level 2 Penguin graded readers and administered to 166 students over a semester. Item facility for high-scorers and…

These are the appendixes for the report, "English Proficiency and the Pandemic: How Texas English Learner Students Fared during the COVID-19 Pandemic. REL 2023-144." This study examined levels of English proficiency before and during the COVID-19 pandemic among English learner students in grades 3-12 in Texas. In 2020-2021, nearly…

In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

Language proficiency testing serves an important function of classifying examinees into different categories of ability. However, misclassification is to some extent inevitable and may have important consequences for stakeholders. Recent research suggests that classification efficacy may be enhanced substantially using computerized adaptive…

Gender fairness in testing can be impeded by the presence of differential item functioning (DIF), which potentially causes test bias. In this study, the presence and causes of gender-related DIF were investigated with real data from 800 items answered by 250,000 test takers. DIF was examined using the Mantel-Haenszel and logistic regression…

This study examines differences in English language comprehension, reading fluency, and executive functions among Spanish-English bilinguals with reading difficulties. Reading difficulties examined included general reading difficulties, defined by low word reading and reading comprehension, and specific-reading comprehension difficulties, defined…

This study examines differences in English language comprehension, reading fluency, and executive functions among Spanish-English bilinguals with reading difficulties. Reading difficulties examined included general reading difficulties, defined by low word reading and reading comprehension, and specific-reading comprehension difficulties, defined…