Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to…

Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to…

This study aims to compare the G and Phi coefficients as estimated by D studies for a measurement tool with the G and Phi coefficients obtained from real cases in which items of differing difficulty levels were added and also to determine the conditions under which the D studies estimated reliability coefficients closer to reality. The study group…

Writing assessments often consist of students responding to multiple prompts, which are judged by more than one rater. To establish the reliability of these assessments, there exist different methods to disentangle variation due to prompts and raters, including classical test theory, Many Facet Rasch Measurement (MFRM), and Generalizability Theory…

Pedagogical shifts that incorporate multimodal and digital literacies challenge the world in which literacy teachers have lived and worked. Effective professional development (PD) experiences may increase teachers' knowledge and enlarge their teaching paradigms about writing instruction. The current study explored ways PD might encourage teachers…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

A prompt can be used as a medium to help students write a descriptive text. There is a lack of research on the type of prompts which can help students formulate and organize their ideas. Therefore, this study aims to determine whether there was a significant difference in the score of idea formulation and organization in a descriptive text between…

This study provides significant advances in the understanding and utility of writing assessment for progress monitoring writing instruction. We explored the validity of a new writing tool that asks students in Grades 3 through 8 to read and respond to informational passages. The written response is then scored for writing fluency. Results…

The New York State Education Department (NYSED) has a partnership with NWEA for the development of the 2024 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2024 Grades 6 and 7 English Language…

This reflective action research documents the mutual learning experiences of three education stakeholders as they construct their language assessment literacy (LAL). A?teacher educator, an inservice teacher, and a preservice teacher were the three stakeholders who took part in a project on language assessment development for ESOL students at a…

The purpose of this study was to determine whether struggling adolescent writers could learn sentence and paragraph writing skills from a software program. Nine junior-high and nine senior-high struggling writers participated in a multiple-probe across-students design that was replicated six times. Instructional procedures within the software…

Scenario-based writing assessment has two salient characteristics by design: a lead-in/essay scaffolding structure and a unified scenario/topic throughout. In this study, we examine whether the scenario-based assessment design would impact students' essay scores compared to its alternative conditions, which intentionally broke the scaffolding…

This study investigates how different form-focused instruction (FFI) timing impacts English as a foreign language (EFL) learners' grammar development. A total of 169 Chinese middle school learners were assigned to four conditions randomly: control, before-isolated FFI, integrated FFI, and after-isolated FFI. The three experimental groups received…

In many states, writing is tested only in selected grades causing writing instruction often to be over-emphasized some years and neglected in others. The present study examines how students' motivation for writing differs during the middle school years. We administered the "Self-Beliefs, Writing Beliefs, and Attitude Survey" (SWAS) to a…

The authors of this article call upon classroom memories to demonstrate the harm of the standardized testing apparatus in the English Language Arts (ELA) classroom. Goal setting under the Every Student Succeeds Act (ESSA) has led to targeted school intervention based on metrics, and many states have chosen to double down on standardized ELA and…