ERIC Number: EJ1265351
Record Type: Journal
Publication Date: 2020-Sep
Pages: 19
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0007-1013
EISSN: N/A
Automatic Assessment of Cognitive and Emotional States in Virtual Reality-Based Flexibility Training for Four Adolescents with Autism
Moon, Jewoong; Ke, Fengfeng; Sokolikj, Zlatko
British Journal of Educational Technology, v51 n5 p1766-1784 Sep 2020
Tracking students' learning states to provide tailored learner support is a critical element of an adaptive learning system. This study explores how an automatic assessment is capable of tracking learners' cognitive and emotional states during virtual reality (VR)-based representational-flexibility training. This VR-based training program aims to promote the flexibility of adolescents with autism spectrum disorder (ASD) in interpreting, selecting and creating multimodal representations during STEM-related design problem solving. For the automatic assessment, we used both natural language processing (NLP) and machine-learning techniques to develop a multi-label classification model. We then trained the model with the data from a total of audio- and video-recorded 66 training sessions of four adolescents with ASD. To validate the model, we implemented both k-fold cross-validations and the manual evaluations by expert reviewers. The study finding suggests the feasibility of implementing the NLP and machine-learning driven automatic assessment to track and assess the cognitive and emotional states of individuals with ASD during VR-based flexibility training. The study finding also denotes the importance and viability of providing adaptive supports to maintain learners' cognitive and affective engagement in a highly interactive digital learning environment.
Descriptors: Adolescents, Autism, Pervasive Developmental Disorders, Learning Processes, Psychological Patterns, Computer Simulation, Computer Assisted Testing, Training, Problem Solving, STEM Education, Natural Language Processing, Man Machine Systems, Audio Equipment, Video Technology, Electronic Learning
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: National Science Foundation (NSF)
Authoring Institution: N/A
Grant or Contract Numbers: 1837917