Loading [a11y]/accessibility-menu.js
Embeddings for Automatic Short Answer Grading: A Scoping Review | IEEE Journals & Magazine | IEEE Xplore

Embeddings for Automatic Short Answer Grading: A Scoping Review


Abstract:

Automatic grading of short answers is an important task in computer-assisted assessment (CAA). Recently, embeddings, as semantic-rich textual representations, have been i...Show More

Abstract:

Automatic grading of short answers is an important task in computer-assisted assessment (CAA). Recently, embeddings, as semantic-rich textual representations, have been increasingly used to represent short answers and predict the grade. Despite the recent trend of applying embeddings in automatic short answer grading (ASAG), there are no systematic reviews of literature reporting on their usage. Therefore, following the PRISMA-ScR guidelines, this scoping review summarizes relevant literature on the use of embeddings in ASAG, and reports on the current state of the art in that research area and on the identified knowledge gaps. We searched seven research databases for the relevant journal, conference, and workshop papers published from 2016 to 2021. The inclusion criteria were based on the type of publication, its venue ranking, study focus, and evaluation methods. Upon the full-text screening, 17 articles were included in the scoping review. Among these, most of the articles used word embeddings, mainly to estimate the similarity of student and model answers using the cosine similarity measure or to initialize a neural network-based classification model. The contribution of embeddings to the performance of ASAG models compared to nonembedding features is inconclusive. Models employing embeddings were mostly evaluated on four public ASAG datasets using earlier ASAG methods as baselines. We summarize the reported evaluation results and draw conclusions on the performance of the state-of-the-art ASAG models.
Published in: IEEE Transactions on Learning Technologies ( Volume: 16, Issue: 2, 01 April 2023)
Page(s): 219 - 231
Date of Publication: 06 March 2023

ISSN Information:

Author image of Marko Putnikovic
University of Belgrade, Belgrade, Serbia
Marko Putnikovic received the B.Sc. degree in informatics and software engineering from the University of Belgrade, Belgrade, Serbia, in 2017, and the M.Sc. degree in informatics and artificial intelligence from the Université Grenoble Alpes, Grenoble, France, in 2018. He is currently working toward the Ph.D. degree in intelligent systems with the University of Belgrade.
His research interests include natural language proc...Show More
Marko Putnikovic received the B.Sc. degree in informatics and software engineering from the University of Belgrade, Belgrade, Serbia, in 2017, and the M.Sc. degree in informatics and artificial intelligence from the Université Grenoble Alpes, Grenoble, France, in 2018. He is currently working toward the Ph.D. degree in intelligent systems with the University of Belgrade.
His research interests include natural language proc...View more
Author image of Jelena Jovanovic
Faculty of Organizational Sciences, University of Belgrade, Belgrade, Serbia
Jelena Jovanovic received the B.Sc., M.Sc., and Ph.D. degrees from the University of Belgrade, Belgrade, Serbia, in 2003, 2005, and 2007, respectively, all in informatics and software engineering.
She is currently a Professor with the Department of Software Engineering, University of Belgrade. Her research interests include semantic technologies, learning analytics, and technology enhanced learning.
Jelena Jovanovic received the B.Sc., M.Sc., and Ph.D. degrees from the University of Belgrade, Belgrade, Serbia, in 2003, 2005, and 2007, respectively, all in informatics and software engineering.
She is currently a Professor with the Department of Software Engineering, University of Belgrade. Her research interests include semantic technologies, learning analytics, and technology enhanced learning.View more

Author image of Marko Putnikovic
University of Belgrade, Belgrade, Serbia
Marko Putnikovic received the B.Sc. degree in informatics and software engineering from the University of Belgrade, Belgrade, Serbia, in 2017, and the M.Sc. degree in informatics and artificial intelligence from the Université Grenoble Alpes, Grenoble, France, in 2018. He is currently working toward the Ph.D. degree in intelligent systems with the University of Belgrade.
His research interests include natural language processing and intelligent educational systems.
Marko Putnikovic received the B.Sc. degree in informatics and software engineering from the University of Belgrade, Belgrade, Serbia, in 2017, and the M.Sc. degree in informatics and artificial intelligence from the Université Grenoble Alpes, Grenoble, France, in 2018. He is currently working toward the Ph.D. degree in intelligent systems with the University of Belgrade.
His research interests include natural language processing and intelligent educational systems.View more
Author image of Jelena Jovanovic
Faculty of Organizational Sciences, University of Belgrade, Belgrade, Serbia
Jelena Jovanovic received the B.Sc., M.Sc., and Ph.D. degrees from the University of Belgrade, Belgrade, Serbia, in 2003, 2005, and 2007, respectively, all in informatics and software engineering.
She is currently a Professor with the Department of Software Engineering, University of Belgrade. Her research interests include semantic technologies, learning analytics, and technology enhanced learning.
Jelena Jovanovic received the B.Sc., M.Sc., and Ph.D. degrees from the University of Belgrade, Belgrade, Serbia, in 2003, 2005, and 2007, respectively, all in informatics and software engineering.
She is currently a Professor with the Department of Software Engineering, University of Belgrade. Her research interests include semantic technologies, learning analytics, and technology enhanced learning.View more
Contact IEEE to Subscribe

References

References is not available for this document.