This study proposes a classification method for multiple text reading test formats in English language proficiency tests. A preliminary study involving 11 proficiency tests revealed two tests that fit the scope of the main study. Results show that multiple text reading test formats use complementary texts rather than conflicting texts. As for…

Various stakeholders, such as policymakers and educators, require diagnostic feedback and actionable test results. One particular context in which fine-grained test results are of utmost importance is English language proficiency (ELP) assessments as they are used for critical decisions for students. Diagnostic classification models (DCMs) afford…

This study sought to find if the implementation of the strategy of goal setting and reflective portfolios would improve reading comprehension among long-term English learners (LTELs), which in turn would impact their FastBridge aReading scores. LTELs have difficulty reclassifying, resulting in negative outcomes regarding graduation rates and…

Given the significant global influence of the Common European Framework of Reference for Languages: Teaching, Learning, and Assessment (CEFR) on English language education, this study deals with aligning a university's academic reading tests to the CEFR. It aimed at validating the test construct of the academic reading tests in relation to the…

Research on the use of standardized test scores in higher education reveals significant variations in attitudes and perceptions of language proficiency tests among test score users. Most test score users have limited knowledge about test score interpretations in terms of what English as additional language (EAL) students typically know and can do…

Research involving digital games and language learning is rapidly growing. One advantage of using digital games to support language learning is the ability to collect data on students learning in real time. In this study, we use educational data mining methods to explore the relationship between in-game data and elementary students' Chinese…

Metacognitive awareness is considered a crucial factor in reading comprehension. In the present study, the quantitative research method was applied using descriptive statistics, T-test, and ANOVA to identify: (1) What is second language (L2) Vietnamese students' metacognitive awareness of reading strategies? (2) Are there any significant…

These are the appendixes for the report, "English Proficiency and the Pandemic: How Texas English Learner Students Fared during the COVID-19 Pandemic. REL 2023-144." This study examined levels of English proficiency before and during the COVID-19 pandemic among English learner students in grades 3-12 in Texas. In 2020-2021, nearly…

In this study, we define the term "screener test," elaborate key considerations in test design, and describe how to incorporate the concepts of practicality and argument-based validation to drive an evaluation of screener tests for language assessment. A screener test is defined as a brief assessment designed to identify an examinee as a…

Language proficiency testing serves an important function of classifying examinees into different categories of ability. However, misclassification is to some extent inevitable and may have important consequences for stakeholders. Recent research suggests that classification efficacy may be enhanced substantially using computerized adaptive…

Norm-referenced error analysis is useful for understanding individual differences in students' academic skill development and for identifying areas of skill strength and weakness. The purpose of the present study was to identify underlying connections between error categories across five language and math subtests of the Kaufman Test of…

English learners' (ELs) day-to-day experiences in school change when reclassified as fully English proficient. Prior research, however, is mixed on how reclassification influences outcomes. Many studies also do not or cannot explore key long-term outcomes or identify impacts over time. In this study I leverage longitudinal student data in a…

Cognitive diagnostic models (CDMs) have great promise for providing diagnostic information to aid learning and instruction, and a large number of CDMs have been proposed. However, the assumptions and performances of different CDMs and their applications in regard to reading comprehension tests are not fully understood. In the present study, we…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…

In response to a request for additional analyses, in particular reporting confidence intervals around the results, we re-analyzed the data from prior studies. This supplementary report presents the results of the additional analyses addressing classification accuracy, reliability, and criterion-related validity evidence. For ease of reference, we…