ERIC Number: ED605912
Record Type: Non-Journal
Publication Date: 2019-Jun-21
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-
EISSN: N/A
Predicting Multi-Document Comprehension: Cohesion Network Analysis
Nicula, Bogdan; Perret, Cecile A.; Dascalu, Mihai; McNamara, Danielle S.
Grantee Submission, Paper presented at the International Conference of Artificial Intelligence in Education (AIED) (20th, Chicago, IL, 2019)
Theories of discourse argue that comprehension depends on the coherence of the learner's mental representation. Our aim is to create a reliable automated representation to estimate readers' level of comprehension based on different productions, namely self-explanations and answers to open-ended questions. Previous work relied on Cohesion Network Analysis to model a cohesion graph composed of semantic links between multiple reference texts and student productions. From this graph, a set of features was derived and used to build machine learning models to predict student comprehension scores. In this paper, we build on top of the previous study by: a) extending the CNA graph by adding new semantic links targeting specific sentences that should have been captured within the learner's productions, and b) cleaning the self-explanations by eliminating frozen expression, as well as entries which seemed nearly identical to the source text. The results are in line with the conclusions of the previous study regarding the importance of both self-explanations and question answers in predicting the students' reading comprehension level. They also outline the limitations of our feature generation approach, in which no substantial improvements were detected, despite adding more fine-grained features. [This paper was published in: Isotani, S., Millán, E.,Ogan, A., Hastings, P., McLaren, B. & Luckin, R. (Eds.), "Proceedings of the 20th International Conference of Artificial Intelligence in Education (AIED) in Chicago, IL" (pp. 358-369). Cham, Switzerland: Springer.]
Publication Type: Speeches/Meeting Papers; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: Institute of Education Sciences (ED); Office of Naval Research (ONR)
Authoring Institution: N/A
IES Funded: Yes
Grant or Contract Numbers: R305A180144; R305A180261; N000141712300