During the era of accountability in K-12 schools in the U.S., school leaders' and teachers' responsibilities concerning language proficiency assessments extend beyond test administration and determination of eligibility for services. State and federal accountability systems challenge educators and school leaders to use language assessment results…

Testing reading has always been indispensable in language tests. The present study aims to evaluate three parallel reading tests from the National College English Test Band Four (CET-4) in June 2021 in terms of reading ability orientations, text readability and its correlations with reading performances. The quantitative analysis reveals: (1) in…

Students with emotional and behavioral challenges often struggle with writing. Curriculum-based measurement (CBM) is an assessment used for a variety of purposes including screening, progress monitoring, and data-based individualization. However, little research has examined technical properties of writing CBM data and supported inferences. This…

Remote proctoring, or monitoring test takers through internet-based, video-recording software, has become critical for maintaining test security on high-stakes assessments. The main role of remote proctors is to make judgments about test takers' behaviors and decide whether these behaviors constitute rule violations. Variability in proctor…

Cognitive diagnostic assessment (CDA) intends to identify learners' strengths and weaknesses in latent cognitive attributes to provide personalized remedial instructions. Previous CDA studies on English as a Foreign Language (EFL)/English as a Second Language (ESL) writing have adopted dichotomous cognitive diagnostic models (CDMs) to analyze data…

Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

The purpose of this study was to compare the functioning of five restrictive CDMs, including DINA, DINO, A-CDM, LLM, and RRUM, against the G-DINA model to identify the best-fitting CDM which can better explain the interaction underlying the attributes of the reading comprehension section of an Iranian high-stakes language proficiency test. To this…

Cloze tests are commonly used in language testing as a quick measure of overall language ability or reading comprehension. A problem for the analysis of cloze tests with item response theory models is that cloze test items are locally dependent. This leads to the violation of the conditional or local independence assumption of IRT models. In this…

Becoming one of six official United Nations languages, English proficiency has become a prominent requirement for students and professionals entering international education and/ or careers, as assessed through standardized English proficiency tests. English learners conducted varied procedures to pursue the minimum test score criteria, including…

Vocabulary is an essential component of language learning. Despite the fact that form-focused instruction (hereinafter FFI) has been demonstrated to be effective in language learning, it remains unclear when and how FFI can contribute to vocabulary learning. To address this question, this study takes the timing of FFI into consideration and…

A language 'test' is a systematic procedure for observing a person's behavior and describing it with the aid of a numerical scale or category system (Cronbach LJ 1971: 26). A test cannot be based on a selection of items chosen on linguistic grounds alone, and that to devise an effective test, it is necessary to specify how an examinee requires to…

The thrust of this study was to investigate the impact of learning styles in general and Field dependence/Independence (FD/I) in particular on the receptive/productive lexical performance of language learners. It aimed to check whether FD/I learners perform differently on receptive and productive vocabulary tests. To achieve this, first, 94…

The same L2 speaking performance may be analysed and evaluated in very different ways by different teachers or raters. We present a new, technology-assisted research design which opens up to investigation the trajectories of convergence and divergence between raters. We tracked and recorded what different raters noticed when, whilst grading a…

In this paper we use historic score-reporting records and test-taker metadata to inform data-driven recommendations that support international students in their choice of undergraduate institutions for study in the United States. We investigate the use of Structural Topic Modeling (STM) as a context-aware, probabilistic recommendation method that…

In order to promote the internationalisation of education and professional mobility, higher education worldwide has seen the need to increase opportunities for students to develop English competence. To ensure that students meet desired linguistic objectives upon graduation, universities commonly use standardised tests. In the context of this…