Heterogeneity in Extended Reality Influences Procedural Knowledge Gain and Operation Training | IEEE Journals & Magazine | IEEE Xplore

Heterogeneity in Extended Reality Influences Procedural Knowledge Gain and Operation Training


Abstract:

Extended reality (XR) is a general term for virtual reality (VR), augmented reality (AR), and mixed reality (MR). By converting abstract digital expressions into intellig...Show More

Abstract:

Extended reality (XR) is a general term for virtual reality (VR), augmented reality (AR), and mixed reality (MR). By converting abstract digital expressions into intelligent feedback through figures, one can effectively compensate for the poor performance of traditional learning in deep cognitive processing and operational skills training. However, the extant results are uncertain, and only a limited number of studies have investigated the influence mechanism of heterogeneity among VR, AR, and MR on procedural knowledge learning, higher-level presence and generative cognitive processing, higher-quality operational behavior, and knowledge transfer. This study explored and analyzed the influence of XR heterogeneity on procedural knowledge gain and operation training. Participants (n = 127) were recruited from junior undergraduate students majoring in rail traffic signal and control. Based on the procedural disassembly and assembly of the ZD6 electric switch machine, an XR pretraining system and a 3-D-printed combined virtual-real procedural training system were developed to collect three types of data regarding knowledge gain, procedural training, and a set of questionnaires. Subsequently, a one-way analysis of variance was conducted with XR as the moderator variable. The results indicate that fully immersive VR is more conducive to procedural operation training; however, space and real factors must be considered. AR is consistent with the learner's operating habits, but the corresponding lack of immersion and interactivity restricts the improvement of procedural learning effects. MR multimodal perception leads to an increase in cognitive load, but moderate cognitive pressure is conducive to the cultivation of procedural cognition skills. Furthermore, this study proposes suggestions for using XR to intensify the perception and understanding of procedural cognitive actions.
Published in: IEEE Transactions on Learning Technologies ( Volume: 16, Issue: 6, December 2023)
Page(s): 1014 - 1033
Date of Publication: 19 June 2023

ISSN Information:

Funding Agency:

Author image of Jiu Yong
College of Intelligence and Computing, Tianjin University, Tianjin, China
National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University, Lanzhou, China
Jiu Yong received the B.S. degree in computer science and technology from Gansu Agriculture University, Lanzhou, China, in 2014, and the M.S. degree in computer application technology from Lanzhou Jiaotong University, Lanzhou, in 2017. He is currently working toward the Ph.D. degree in computer science and technology with Tianjin University, Tianjin, China.
He is currently a Teacher with the National Virtual Simulation Exp...Show More
Jiu Yong received the B.S. degree in computer science and technology from Gansu Agriculture University, Lanzhou, China, in 2014, and the M.S. degree in computer application technology from Lanzhou Jiaotong University, Lanzhou, in 2017. He is currently working toward the Ph.D. degree in computer science and technology with Tianjin University, Tianjin, China.
He is currently a Teacher with the National Virtual Simulation Exp...View more
Author image of Jianguo Wei
College of Intelligence and Computing, Tianjin University, Tianjin, China
Jianguo Wei (Member, IEEE) received the B.S. degree in microelectronics from Jilin University, Changchun, China, in 1995, the M.S. degree in computer science and technology from Tianjin University, Tianjin, China, in 2002, and the Ph.D. degree in computer science from Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
He is currently a Professor with the College of Intelligence and Computing,...Show More
Jianguo Wei (Member, IEEE) received the B.S. degree in microelectronics from Jilin University, Changchun, China, in 1995, the M.S. degree in computer science and technology from Tianjin University, Tianjin, China, in 2002, and the Ph.D. degree in computer science from Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
He is currently a Professor with the College of Intelligence and Computing,...View more
Author image of Yangping Wang
National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University, Lanzhou, China
Yangping Wang received the B.S. degree in computer application technology from Northwestern Polytechnical University, Xi'an, China, in 1996, and the M.S. degree in computer application technology and the Ph.D. degree in traffic information engineering and control from Lanzhou Jiaotong University, Lanzhou, China, in 2005 and 2010, respectively.
She is currently a Professor with the National Virtual Simulation Experiment Tea...Show More
Yangping Wang received the B.S. degree in computer application technology from Northwestern Polytechnical University, Xi'an, China, in 1996, and the M.S. degree in computer application technology and the Ph.D. degree in traffic information engineering and control from Lanzhou Jiaotong University, Lanzhou, China, in 2005 and 2010, respectively.
She is currently a Professor with the National Virtual Simulation Experiment Tea...View more
Author image of Jianwu Dang
National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University, Lanzhou, China
Jianwu Dang received the B.S. degree in autocontrol from Lanzhou Jiaotong University, Lanzhou, China, in 1986, and the M.S. degree in computer application and the Ph.D. degree in railway traction electrification and automation from Southwest Jiaotong University, Chengdu, China, in 1992 and 1996, respectively.
He is currently a Professor with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Info...Show More
Jianwu Dang received the B.S. degree in autocontrol from Lanzhou Jiaotong University, Lanzhou, China, in 1986, and the M.S. degree in computer application and the Ph.D. degree in railway traction electrification and automation from Southwest Jiaotong University, Chengdu, China, in 1992 and 1996, respectively.
He is currently a Professor with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Info...View more
Author image of Xiaomei Lei
Meteorological Information and Technological Supporting Center, Gansu Province Meteorological Bureau, Lanzhou, China
Xiaomei Lei received the B.S. degree in communication engineering from Lanzhou Jiaotong University, Lanzhou, China, in 2014, and the M.S. degree in information and communication systems from Lanzhou Jiaotong University, in 2017.
She is currently an Engineer with the Meteorological Information and Technological Supporting Center, Gansu Province Meteorological Bureau, Lanzhou. Her research focuses on virtual visualization ap...Show More
Xiaomei Lei received the B.S. degree in communication engineering from Lanzhou Jiaotong University, Lanzhou, China, in 2014, and the M.S. degree in information and communication systems from Lanzhou Jiaotong University, in 2017.
She is currently an Engineer with the Meteorological Information and Technological Supporting Center, Gansu Province Meteorological Bureau, Lanzhou. Her research focuses on virtual visualization ap...View more
Author image of Wenhuan Lu
College of Intelligence and Computing, Tianjin University, Tianjin, China
Wenhuan Lu (Member, IEEE) received the B.S. degree in phonetics and the M.S. degree in computer application technology from Tianjin Normal University, Tianjin, China, in 1996 and 2004, respectively, and the Ph.D. degree in artificial intelligence from the Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
She is currently a Professor with the College of Intelligence and Computing, Tianjin Uni...Show More
Wenhuan Lu (Member, IEEE) received the B.S. degree in phonetics and the M.S. degree in computer application technology from Tianjin Normal University, Tianjin, China, in 1996 and 2004, respectively, and the Ph.D. degree in artificial intelligence from the Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
She is currently a Professor with the College of Intelligence and Computing, Tianjin Uni...View more

Author image of Jiu Yong
College of Intelligence and Computing, Tianjin University, Tianjin, China
National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University, Lanzhou, China
Jiu Yong received the B.S. degree in computer science and technology from Gansu Agriculture University, Lanzhou, China, in 2014, and the M.S. degree in computer application technology from Lanzhou Jiaotong University, Lanzhou, in 2017. He is currently working toward the Ph.D. degree in computer science and technology with Tianjin University, Tianjin, China.
He is currently a Teacher with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University. His research interests include XR and education applied.
Jiu Yong received the B.S. degree in computer science and technology from Gansu Agriculture University, Lanzhou, China, in 2014, and the M.S. degree in computer application technology from Lanzhou Jiaotong University, Lanzhou, in 2017. He is currently working toward the Ph.D. degree in computer science and technology with Tianjin University, Tianjin, China.
He is currently a Teacher with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University. His research interests include XR and education applied.View more
Author image of Jianguo Wei
College of Intelligence and Computing, Tianjin University, Tianjin, China
Jianguo Wei (Member, IEEE) received the B.S. degree in microelectronics from Jilin University, Changchun, China, in 1995, the M.S. degree in computer science and technology from Tianjin University, Tianjin, China, in 2002, and the Ph.D. degree in computer science from Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
He is currently a Professor with the College of Intelligence and Computing, Tianjin University. His research interests include intelligent speech interaction and applied.
Jianguo Wei (Member, IEEE) received the B.S. degree in microelectronics from Jilin University, Changchun, China, in 1995, the M.S. degree in computer science and technology from Tianjin University, Tianjin, China, in 2002, and the Ph.D. degree in computer science from Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
He is currently a Professor with the College of Intelligence and Computing, Tianjin University. His research interests include intelligent speech interaction and applied.View more
Author image of Yangping Wang
National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University, Lanzhou, China
Yangping Wang received the B.S. degree in computer application technology from Northwestern Polytechnical University, Xi'an, China, in 1996, and the M.S. degree in computer application technology and the Ph.D. degree in traffic information engineering and control from Lanzhou Jiaotong University, Lanzhou, China, in 2005 and 2010, respectively.
She is currently a Professor with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University. Her research interests include virtual reality, intelligent information processing, and education applied.
Yangping Wang received the B.S. degree in computer application technology from Northwestern Polytechnical University, Xi'an, China, in 1996, and the M.S. degree in computer application technology and the Ph.D. degree in traffic information engineering and control from Lanzhou Jiaotong University, Lanzhou, China, in 2005 and 2010, respectively.
She is currently a Professor with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University. Her research interests include virtual reality, intelligent information processing, and education applied.View more
Author image of Jianwu Dang
National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University, Lanzhou, China
Jianwu Dang received the B.S. degree in autocontrol from Lanzhou Jiaotong University, Lanzhou, China, in 1986, and the M.S. degree in computer application and the Ph.D. degree in railway traction electrification and automation from Southwest Jiaotong University, Chengdu, China, in 1992 and 1996, respectively.
He is currently a Professor with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University. His research interests include intelligent information processing and traffic information engineering.
Jianwu Dang received the B.S. degree in autocontrol from Lanzhou Jiaotong University, Lanzhou, China, in 1986, and the M.S. degree in computer application and the Ph.D. degree in railway traction electrification and automation from Southwest Jiaotong University, Chengdu, China, in 1992 and 1996, respectively.
He is currently a Professor with the National Virtual Simulation Experiment Teaching Center of Railway Traffic Information and Control, Lanzhou Jiaotong University. His research interests include intelligent information processing and traffic information engineering.View more
Author image of Xiaomei Lei
Meteorological Information and Technological Supporting Center, Gansu Province Meteorological Bureau, Lanzhou, China
Xiaomei Lei received the B.S. degree in communication engineering from Lanzhou Jiaotong University, Lanzhou, China, in 2014, and the M.S. degree in information and communication systems from Lanzhou Jiaotong University, in 2017.
She is currently an Engineer with the Meteorological Information and Technological Supporting Center, Gansu Province Meteorological Bureau, Lanzhou. Her research focuses on virtual visualization applications.
Xiaomei Lei received the B.S. degree in communication engineering from Lanzhou Jiaotong University, Lanzhou, China, in 2014, and the M.S. degree in information and communication systems from Lanzhou Jiaotong University, in 2017.
She is currently an Engineer with the Meteorological Information and Technological Supporting Center, Gansu Province Meteorological Bureau, Lanzhou. Her research focuses on virtual visualization applications.View more
Author image of Wenhuan Lu
College of Intelligence and Computing, Tianjin University, Tianjin, China
Wenhuan Lu (Member, IEEE) received the B.S. degree in phonetics and the M.S. degree in computer application technology from Tianjin Normal University, Tianjin, China, in 1996 and 2004, respectively, and the Ph.D. degree in artificial intelligence from the Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
She is currently a Professor with the College of Intelligence and Computing, Tianjin University. Her research interests include intelligent human computer interaction systems and applied.
Wenhuan Lu (Member, IEEE) received the B.S. degree in phonetics and the M.S. degree in computer application technology from Tianjin Normal University, Tianjin, China, in 1996 and 2004, respectively, and the Ph.D. degree in artificial intelligence from the Japan Advanced Institute of Science and Technology (JAIST), Nomi, Japan, in 2007.
She is currently a Professor with the College of Intelligence and Computing, Tianjin University. Her research interests include intelligent human computer interaction systems and applied.View more
Contact IEEE to Subscribe

References

References is not available for this document.