NotesFAQContact Us
Collection
Advanced
Search Tips
Publication Date
In 20250
Since 20240
Since 2021 (last 5 years)1
Descriptor
Comparative Analysis1
Computational Linguistics1
Computer Assisted Testing1
Correlation1
Effect Size1
English (Second Language)1
Essays1
Evaluators1
Interrater Reliability1
Meta Analysis1
Scoring1
Second Language Instruction1
Second Language Learning1
Writing Evaluation1
More ▼
Source
English Teaching1
Author
Jiyeo Yun1
Publication Type
Information Analyses1
Journal Articles1
Education Level
Audience
Location
Laws, Policies, & Programs
Assessments and Surveys
What Works Clearinghouse Rating
Showing one result Save | Export
Meta-Analysis of Inter-Rater Agreement and Discrepancy Between Human and Automated English Essay Scoring
Peer reviewed Peer reviewed
PDF on ERIC Download full text
Direct linkDirect link
Jiyeo Yun – English Teaching, 2023
Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…
Descriptors: Meta Analysis, Interrater Reliability, Essays, Scoring