ERIC Number: EJ1404995
Record Type: Journal
Publication Date: 2024
Pages: 20
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0973
EISSN: EISSN-1940-0683
Using Topic Models to Understand Rater-Mediated Writing Assessments
Journal of Experimental Education, v92 n1 p186-205 2024
Integrated writing assessments are tasks that require students to construct an essay using evidence from source texts. Topic models are statistical models used to analyze text. This study analyzes two integrated writing tasks from students in grades 6 (N=1,250) and 8 (N=1,250) using topic models. Independent evaluations of the essays were also conducted to help generalize the results across the two grades and better understand students' underlying writing techniques. Four main categories were identified: (1) use of words that appeared in the prompt, (2) words that appeared in the source texts, (3) words that reflected inference, and (4) words that reflected integration. Higher-scoring students used words that reflect inference and integration of source text more often than lower-performing students.
Descriptors: Middle School Students, Grade 6, Grade 8, Mathematical Models, Word Processing, Cognitive Mapping, Writing Strategies, Performance Technology
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education; Elementary Education; Grade 6; Intermediate Grades; Grade 8
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A