This paper presents a multidimensional model of variation in writing quality, register, and genre in student essays, trained and tested via confirmatory factor analysis of 1.37 million essay submissions to ETS' digital writing service, Criterion®. The model was also validated with several other corpora, which indicated that it provides a…

Early writing is a foundational component of emergent literacy. Despite recent increases in early writing research, studies often narrowly focus on transcription (i.e., letter and/or name writing, spelling) to the exclusion of their ability to compose or generate ideas and translate into writing. Research investigating composing approaches it in…

This study aims to explore to what extent syntactic complexity predicts holistic scores generated by China's two prominent automated writing evaluation systems--"pigai" and "iWrite," the results of which will have some implications for the validity of these two systems. In the meanwhile, this study targets how syntactic…

Automated writing scoring can not only provide holistic scores but also instant and corrective feedback on L2 learners' writing quality. It has been increasing in use throughout China and internationally. Given the advantages, the past several years has witnessed the emergence and growth of writing evaluation products in China. To the best of our…

Despite increasing pressure for children to learn to write at younger ages, there are many unanswered questions about composition skills in early elementary school. The goal of this research was to examine the dimensionality of composition skills in kindergarten children, thereby adding to current knowledge about the measurement of young…

Despite increasing pressure for children to learn to write at younger ages, there are many unanswered questions about composition skills in early elementary school. The goal of this research was to examine the dimensionality of composition skills in kindergarten children, thereby adding to current knowledge about the measurement of young…

We evaluated the validity of an automated approach to learning progress assessment (aLPA) for English written expression. Participants (n = 105) were students in Grades 2-12 who had parent-identified learning difficulties and received academic tutoring through a community-based organization. Participants completed narrative writing samples in the…

This study investigated fourth and fifth graders' metacognitive knowledge about writing and its relationship to writing performance to help identify areas that might be leveraged when designing effective writing instruction. Students' metacognitive knowledge was probed using a 30-minute informative writing prompt requiring students to teach their…

Lexical items that are encountered more frequently and in varying contexts have important effects on second language (L2) development because frequent and contextually diverse words are learned faster and become more entrenched in a learner's lexicon (Ellis 2002a, b). Despite evidence that L2 learners are generally exposed to non-native input,…

In response to the Elementary and Secondary Education Act in 2001 (No Child Left Behind), states have sought various ways to adequately assess students in order to in turn hold schools and districts accountable for closing the achievement gap. As the state of Texas, motivated by pressure from parents, teachers, and other vested interest groups who…

This paper presents an investigation of score prediction based on natural language processing for two targeted constructs within analytic text-based writing: 1) students' effective use of evidence and, 2) their organization of ideas and evidence in support of their claim. With the long-term goal of producing feedback for students and teachers, we…

Researchers have found numerous differences in the approaches raters take to the complex task of essay rating including differences when rating native (L1) and non-native (L2) English writing. Yet less is known about raters' reading practices while scoring those essays. This small-scale study uses eye-tracking technology and reflective protocols…

Previous studies with English-speaking children showed that handwriting and spelling abilities played a critical role in the development of writing fluency and quality, particularly during the transition from the kindergarten to primary school; in contrast, studies dealing with orthographically transparent languages found small or no relations…

This study investigates how and whether information about students' writing can be recovered from basic behavioral data extracted during their sessions in an intelligent tutoring system for writing. We calculate basic and time-sensitive keystroke indices based on log files of keys pressed during students' writing sessions. A corpus of prompt-based…

Automated written corrective feedback (AWCF) has qualities that distinguish it from teacher-provided WCF and potentially undermine claims about its value for L2 student writers, including disparities in the amounts of useful information it provides across error types and the fact that inaccuracies in error-flagging must be anticipated. It remains…