ERIC Number: EJ1378467
Record Type: Journal
Publication Date: 2023-Jun
Pages: 24
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1360-2357
EISSN: EISSN-1573-7608
Investigating the Effect of Multimodality and Sentiments on Speaking Assessments: A Facial Emotional Analysis
Education and Information Technologies, v28 n6 p7413-7436 Jun 2023
This quasi-experimental study aimed to determine the relationship between (1) oral language ability and emotions represented by facial emotions, and (2) modality of assessment (audios versus videos) and sentiments embedded in each modality. Sixty university students watched and/or listened to four selected audio-visual stimuli and orally answered follow-up comprehension questions. One stimulus was designed to evoke happiness while the other, sadness. Participants' facial emotions during the answering were measured using the "FaceReader" technology. In addition, four trained raters assessed the responses of the participants. An analysis of the "FaceReader" data showed that there were significant main and interaction effects of sentiment and modality on participants' facial emotional expression. Notably, there was a significant difference in the amount of facial emotions evoked by (1) the happy vs. sad sentiment videos and (2) video vs. audio modalities. In contrast, sentiments embedded in the stimuli and modalities had no significant effect on the measured speaking performance of the participants. Nevertheless, we found a number of significant correlations between the participants' test scores and some of their facial emotions evoked by the stimuli. Implications of these findings for the assessment of oral communication are discussed.
Descriptors: Oral Language, Language Skills, Emotional Experience, Affective Behavior, Human Body, Nonverbal Communication, College Students, Evaluation, Visual Stimuli, Acoustics, Psychological Patterns
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://bibliotheek.ehb.be:2123/
Publication Type: Journal Articles; Reports - Research
Education Level: Higher Education; Postsecondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A