ERIC Number: ED630432
Record Type: Non-Journal
Publication Date: 2023
Pages: 7
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: N/A
Automated Assessment of Comprehension Strategies from Self-Explanations Using Transformers and Multi-task Learning
Bogdan Nicula; Marilena Panaite; Tracy Arner; Renu Balyan; Mihai Dascalu; Danielle S. McNamara
Grantee Submission, Paper presented at the Conference on Artificial Intelligence in Education (AIED) (2023)
Self-explanation practice is an effective method to support students in better understanding complex texts. This study focuses on automatically assessing the comprehension strategies employed by readers while understanding STEM texts. Data from 3 datasets (N = 11,833) with self-explanations annotated on different comprehension strategies (i.e., bridging, elaboration, and paraphrasing) and an overall quality score was used to train various machine learning models in both single-task and multi-task setups. Our end-to-end neural architecture considers RoBERTa as an encoder applied to the target and self-explanation texts, combined with handcrafted features for assessing text cohesion and filtering out low-quality examples. The best configuration obtained a 0.699 weighted F1-score for the overall self-explanation quality. [This paper was published in: "AIED 2023, CCIS 1831," edited by N. Wang et al., Springer Nature, 2023, pp. 695-700.]
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); National Science Foundation (NSF)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A130124; R305A190063; REC0241144; IIS0735682