ERIC Number: EJ1375663
Record Type: Journal
Publication Date: 2023-Apr
Pages: 28
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0735-6331
EISSN: EISSN-1541-4140
The Syncretic Effect of Dual-Source Data on Affective Computing in Online Learning Contexts: A Perspective from Convolutional Neural Network with Attention Mechanism
Zhai, Xuesong; Xu, Jiaqi; Chen, Nian-Shing; Shen, Jun; Li, Yan; Wang, Yonggu; Chu, Xiaoyan; Zhu, Yumeng
Journal of Educational Computing Research, v61 n2 p466-493 Apr 2023
Affective computing (AC) has been regarded as a relevant approach to identifying online learners' mental states and predicting their learning performance. Previous research mainly used one single-source data set, typically learners' facial expression, to compute learners' affection. However, a single facial expression may represent different affections in various head poses. This study proposed a dual-source data approach to solve the problem. Facial expression and head pose are two typical data sources that can be captured from online learning videos. The current study collected a dual-source data set of facial expressions and head poses from an online learning class in a middle school. A deep learning neural network using AlexNet with an attention mechanism was developed to verify the syncretic effect on affective computing of the proposed dual-source fusion strategy. The results show that the dual-source fusion approach significantly outperforms the single-source approach based on the AC recognition accuracy between the two approaches (dual-source approach using Attention-AlexNet model 80.96%; single-source approach, facial expression 76.65% and head pose 64.34%). This study contributes to the theoretical construction of the dual-source data fusion approach, and the empirical validation of the effect of the Attention-AlexNet neural network approach on affective computing in online learning contexts.
Descriptors: Affective Behavior, Nonverbal Communication, Video Technology, Online Courses, Middle School Students, Artificial Intelligence, Electronic Learning, Emotional Response, COVID-19, Pandemics, Educational Technology, Models
SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://bibliotheek.ehb.be:2993
Publication Type: Journal Articles; Reports - Research
Education Level: Junior High Schools; Middle Schools; Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A