Loading [a11y]/accessibility-menu.js
A Systematic Literature Review of Game-Based Assessment Studies: Trends and Challenges | IEEE Journals & Magazine | IEEE Xplore

A Systematic Literature Review of Game-Based Assessment Studies: Trends and Challenges


Abstract:

Technology has become an essential part of our everyday life, and its use in educational environments keeps growing. In addition, games are one of the most popular activi...Show More

Abstract:

Technology has become an essential part of our everyday life, and its use in educational environments keeps growing. In addition, games are one of the most popular activities across cultures and ages, and there is ample evidence that supports the benefits of using games for assessment. This field is commonly known as game-based assessment (GBA), which refers to the use of games to assess learners' competencies, skills, or knowledge. In this article, we analyze the current status of the GBA field by performing the first systematic literature review on empirical GBA studies. It is based on 65 research papers that used digital GBAs to determine: the context where the study has been applied, the primary purpose, the domain of the game used, game/tool availability, the size of the data sample, the computational methods and algorithms applied, the targeted stakeholders of the study, and what limitations and challenges are reported by authors. Based on the categories established and our analysis, the findings suggest that GBAs are mainly used in K-16 education and for assessment purposes, and that most GBAs focus on assessing STEM content, and cognitive and soft skills. Furthermore, the current limitations indicate that future GBA research would benefit from the use of bigger data samples and more specialized algorithms. Based on our results, we discuss current trends in the field and open challenges (including replication and validation problems), providing recommendations for the future research agenda of the GBA field.
Published in: IEEE Transactions on Learning Technologies ( Volume: 16, Issue: 4, August 2023)
Page(s): 500 - 515
Date of Publication: 05 December 2022

ISSN Information:

Author image of Manuel J. Gomez
Faculty of Computer Science, University of Murcia, Murcia, Spain
Manuel J. Gomez received the B.Sc. degree with a focus on applied computing and data science from the University of Murcia, in 2020 and the M.Sc. degree in big data from the University of Murcia, in 2021. He is currently working towards the Ph.D. degree in computer science with the University of Murcia, Murcia, Spain.
He is a member of the CyberDataLab at the University of Murcia. His research interests include data mining...Show More
Manuel J. Gomez received the B.Sc. degree with a focus on applied computing and data science from the University of Murcia, in 2020 and the M.Sc. degree in big data from the University of Murcia, in 2021. He is currently working towards the Ph.D. degree in computer science with the University of Murcia, Murcia, Spain.
He is a member of the CyberDataLab at the University of Murcia. His research interests include data mining...View more
Author image of José A. Ruipérez-Valiente
Faculty of Computer Science, University of Murcia, Murcia, Spain
José A. Ruipérez-Valiente (Senior Member, IEEE) received the B.Eng. degree in telecommunications from Universidad Catölica de San Antonio de Murcia, Murcia, Spain, in 2011 and the M.Eng. degree in telecommunications and the M.Sc. and Ph.D. degrees in telematics, all from the Universidad Carlos III of Madrid, Madrid, Spain, in 2013, 2014, and 2017, respectively, while conducting research with institute IMDEA Networks in th...Show More
José A. Ruipérez-Valiente (Senior Member, IEEE) received the B.Eng. degree in telecommunications from Universidad Catölica de San Antonio de Murcia, Murcia, Spain, in 2011 and the M.Eng. degree in telecommunications and the M.Sc. and Ph.D. degrees in telematics, all from the Universidad Carlos III of Madrid, Madrid, Spain, in 2013, 2014, and 2017, respectively, while conducting research with institute IMDEA Networks in th...View more
Author image of Félix J. García Clemente
Faculty of Computer Science, University of Murcia, Murcia, Spain
Félix J. García Clemente received the M.Sc. and Ph.D. degrees in computer science from the University of Murcia (UMU), Murcia, Spain, in 2002 and 2006, respectively.
He is an associate professor with the Department of Computer Engineering, UMU. His teaching includes courses in computer networks, network management, ubiquitous computing, and mobile device programming. His major research interests focus on cybersecurity, dis...Show More
Félix J. García Clemente received the M.Sc. and Ph.D. degrees in computer science from the University of Murcia (UMU), Murcia, Spain, in 2002 and 2006, respectively.
He is an associate professor with the Department of Computer Engineering, UMU. His teaching includes courses in computer networks, network management, ubiquitous computing, and mobile device programming. His major research interests focus on cybersecurity, dis...View more

Author image of Manuel J. Gomez
Faculty of Computer Science, University of Murcia, Murcia, Spain
Manuel J. Gomez received the B.Sc. degree with a focus on applied computing and data science from the University of Murcia, in 2020 and the M.Sc. degree in big data from the University of Murcia, in 2021. He is currently working towards the Ph.D. degree in computer science with the University of Murcia, Murcia, Spain.
He is a member of the CyberDataLab at the University of Murcia. His research interests include data mining, educational technology, game-based assessment, and natural language processing.
Manuel J. Gomez received the B.Sc. degree with a focus on applied computing and data science from the University of Murcia, in 2020 and the M.Sc. degree in big data from the University of Murcia, in 2021. He is currently working towards the Ph.D. degree in computer science with the University of Murcia, Murcia, Spain.
He is a member of the CyberDataLab at the University of Murcia. His research interests include data mining, educational technology, game-based assessment, and natural language processing.View more
Author image of José A. Ruipérez-Valiente
Faculty of Computer Science, University of Murcia, Murcia, Spain
José A. Ruipérez-Valiente (Senior Member, IEEE) received the B.Eng. degree in telecommunications from Universidad Catölica de San Antonio de Murcia, Murcia, Spain, in 2011 and the M.Eng. degree in telecommunications and the M.Sc. and Ph.D. degrees in telematics, all from the Universidad Carlos III of Madrid, Madrid, Spain, in 2013, 2014, and 2017, respectively, while conducting research with institute IMDEA Networks in the area of learning analytics and educational data mining.
He was a Postdoctoral Associate with MIT. He has received more than 20 academic/research awards and fellowships, has authored or coauthored more than 100 scientific publications in high impact venues, and participated in more than 18 funded projects. He is currently an assistant professor of computer science and artificial intelligence with the University of Murcia, Murcia.
José A. Ruipérez-Valiente (Senior Member, IEEE) received the B.Eng. degree in telecommunications from Universidad Catölica de San Antonio de Murcia, Murcia, Spain, in 2011 and the M.Eng. degree in telecommunications and the M.Sc. and Ph.D. degrees in telematics, all from the Universidad Carlos III of Madrid, Madrid, Spain, in 2013, 2014, and 2017, respectively, while conducting research with institute IMDEA Networks in the area of learning analytics and educational data mining.
He was a Postdoctoral Associate with MIT. He has received more than 20 academic/research awards and fellowships, has authored or coauthored more than 100 scientific publications in high impact venues, and participated in more than 18 funded projects. He is currently an assistant professor of computer science and artificial intelligence with the University of Murcia, Murcia.View more
Author image of Félix J. García Clemente
Faculty of Computer Science, University of Murcia, Murcia, Spain
Félix J. García Clemente received the M.Sc. and Ph.D. degrees in computer science from the University of Murcia (UMU), Murcia, Spain, in 2002 and 2006, respectively.
He is an associate professor with the Department of Computer Engineering, UMU. His teaching includes courses in computer networks, network management, ubiquitous computing, and mobile device programming. His major research interests focus on cybersecurity, distributed management of networks and services, and interaction systems.
Félix J. García Clemente received the M.Sc. and Ph.D. degrees in computer science from the University of Murcia (UMU), Murcia, Spain, in 2002 and 2006, respectively.
He is an associate professor with the Department of Computer Engineering, UMU. His teaching includes courses in computer networks, network management, ubiquitous computing, and mobile device programming. His major research interests focus on cybersecurity, distributed management of networks and services, and interaction systems.View more
Contact IEEE to Subscribe

References

References is not available for this document.