Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to…

Recent advances in automated writing evaluation have enabled educators to use automated writing quality scores to improve assessment feasibility. However, there has been limited investigation of bias for automated writing quality scores with students from diverse racial or ethnic backgrounds. The use of biased scores could contribute to…

This study aims to compare the G and Phi coefficients as estimated by D studies for a measurement tool with the G and Phi coefficients obtained from real cases in which items of differing difficulty levels were added and also to determine the conditions under which the D studies estimated reliability coefficients closer to reality. The study group…

Writing assessments often consist of students responding to multiple prompts, which are judged by more than one rater. To establish the reliability of these assessments, there exist different methods to disentangle variation due to prompts and raters, including classical test theory, Many Facet Rasch Measurement (MFRM), and Generalizability Theory…

Pedagogical shifts that incorporate multimodal and digital literacies challenge the world in which literacy teachers have lived and worked. Effective professional development (PD) experiences may increase teachers' knowledge and enlarge their teaching paradigms about writing instruction. The current study explored ways PD might encourage teachers…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

A prompt can be used as a medium to help students write a descriptive text. There is a lack of research on the type of prompts which can help students formulate and organize their ideas. Therefore, this study aims to determine whether there was a significant difference in the score of idea formulation and organization in a descriptive text between…

The New York State Education Department (NYSED) has a partnership with NWEA for the development of the 2024 Grades 3-8 English Language Arts Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2024 Grades 6 and 7 English Language…

This reflective action research documents the mutual learning experiences of three education stakeholders as they construct their language assessment literacy (LAL). A?teacher educator, an inservice teacher, and a preservice teacher were the three stakeholders who took part in a project on language assessment development for ESOL students at a…

The purpose of this study was to determine whether struggling adolescent writers could learn sentence and paragraph writing skills from a software program. Nine junior-high and nine senior-high struggling writers participated in a multiple-probe across-students design that was replicated six times. Instructional procedures within the software…

This study investigates how different form-focused instruction (FFI) timing impacts English as a foreign language (EFL) learners' grammar development. A total of 169 Chinese middle school learners were assigned to four conditions randomly: control, before-isolated FFI, integrated FFI, and after-isolated FFI. The three experimental groups received…

In this study, I investigate whether three A2 Key for Schools practice tests from Cambridge Assessment English for 6th-graders (11-12 years old) in Argentina measure growth and produce scores that are meaningful. Drawing data from three consecutive years, I analyze the scores of 80 children over a school year and consider whether the tests are…

During the academic year in the state of Georgia, EL students in public schools take the Georgia Milestones End-of-Grade and the ACCESS 2.0 assessments, which are in line with the state-mandated subject area standards in mathematics, science, language arts, and social studies, as well as English language proficiency standards (Georgia Department…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

Standardized testing and accountability are currently unavoidable components of Texas Public Education. Through years of push-back, parents and educators have demanded that Texas consider alternative testing options that would reduce the high-stakes testing burden on students and schools. In 2015, the State of Texas passed legislation requiring…