This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…

Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the…

Due to pressure to meet goals, some test-takers preparing for the IELTS (International English Language Testing System) Writing test solicit written feedback (WF) from an expert provider on their rehearsal essays, in order to identify and close gaps in performance. The extent self-directed candidates are able to utilize written feedback to enhance…

Writing assessment can be used for a variety of purposes, both inside the classroom and outside: supporting student learning, assigning a grade, placing students in appropriate courses, allowing them to exit a course or sequence of courses, certifying proficiency, and evaluating programs. Given the high-stakes nature of many of these assessment…

In public school classrooms across the United States, approximately one in ten students is learning English as a second language. These students, often referred to as English language learners (ELLs), comprise one of the fastest growing demographic groups in the United States, with approximately 5 million ELLs enrolled in public schools across the…

Differences in rater judgments that are systematically related to construct-irrelevant characteristics threaten the fairness of rater-mediated writing assessments. Accordingly, it is essential that researchers and practitioners examine the degree to which the psychometric quality of rater judgments is comparable across test-taker subgroups.…

Language assessment literacy has emerged as an important area of research within the field of language testing and assessment, garnering increasing scholarly attention. However, the existing literature on language assessment literacy primarily focuses on teachers and administrators, while students, who sit at the heart of any assessment, are…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

In successful writing development, English as a foreign language (EFL) learners not only need to acquire grammatical complexity (GC) features but also know when and how to use them flexibly across communicative contexts, known as register flexibility. The present study, guided by the sociocultural theory of language learning, examines descriptive…

Self-regulated reading-to-write (R2W) can be portrayed as learners' proactive learning of useful elements (e.g. content, rhetorical features, and conventions) from reading by using strategies, which is an effective mechanism connecting reading and writing, to improve their writing competence. In the present study, six major types of self-regulated…

The simple view of writing suggests that written composition results from oral language, transcription (e.g., spelling/handwriting), and self-regulation skills, coordinated within working memory. The model provides a number of implications for the interpretation of psychoeducational achievement batteries. For instance, it hypothesizes that writing…

This study introduces a novel differential item functioning (DIF) method based on propensity score matching that tackles two challenges in analyzing performance assessment data, that is, continuous task scores and lack of a reliable internal variable as a proxy for ability or aptitude. The proposed DIF method consists of two main stages. First,…

This study intended to explore the different types of phraseological units in IELTS academic writing task 2 and probe into the IELTS candidates' perceptions of phraseological competence. To this end, a corpus entailing 100 essays (26,423 words) written for IELTS writing task 2 was scrutinized, through which phraseological units were extracted and…

Conceptual models of early writing suggest multiple component skills support children's early writing development. Although research interest in early writing skills has grown in recent years, the majority of studies focus narrowly on procedural knowledge or transcription skills (i.e., handwriting and spelling) to the relative exclusion of how…

Researchers studying curriculum-based measurement of written expression have used a variety of writing prompt types and durations when establishing criterion validity of these tools. The purpose of this study was to determine through meta-analytic procedures whether any prompt type or duration was superior to others in terms of criterion validity.…