Loading [a11y]/accessibility-menu.js
LearnEval Peer Assessment Platform: Iterative Development Process and Evaluation | IEEE Journals & Magazine | IEEE Xplore

LearnEval Peer Assessment Platform: Iterative Development Process and Evaluation


Abstract:

Peer assessment is a valuable educational activity, which promotes learner engagement and critical thinking, while also decreasing the time spent by the teachers on evalu...Show More

Abstract:

Peer assessment is a valuable educational activity, which promotes learner engagement and critical thinking, while also decreasing the time spent by the teachers on evaluating students’ work. Over the past decades, several platforms have been proposed to support the peer assessment process. The current landscape is dominated by special-purpose, context-specific peer evaluation systems, which were designed to support a particular type of learning activity, artifact, or discipline. In this article, we propose an alternative, a generic and comprehensive peer assessment platform, called LearnEval, which is very flexible and able to accommodate a variety of pedagogical scenarios. Distinctive functionalities include: highly configurable peer assessment workflow, several automatic and manual review allocation mechanisms, initial calibration/training options for the students, complex dashboard with statistics, scores and graphical visualizations, as well as an extensive open learner model. The platform was developed in an iterative manner, with several extensions and improvements informed by the findings of the initial pilot studies. The article also reports on a practical application of LearnEval in a project-based learning scenario, with very promising results; multiple perspectives of the peer assessment process are analyzed: student behavior, peer grades validity, and perceived learning experience. Comparative results with an earlier study show increased levels of system usability, grading validity, and student satisfaction.
Published in: IEEE Transactions on Learning Technologies ( Volume: 15, Issue: 3, 01 June 2022)
Page(s): 421 - 433
Date of Publication: 22 June 2022

ISSN Information:

Funding Agency:

Author image of Gabriel Badea
Computers and Information Technology Department, University of Craiova, Craiova, Romania
Gabriel Badea received the B.Sc. degree in computer science and the M.Sc. degree in information systems for e-business in 2016 and 2018, respectively, from the University of Craiova, Craiova, Romania, where he is currently working toward the Ph.D. degree.
He has been a Teaching Assistant with the University of Craiova since 2018. His major research interests are related to technology enhanced learning and peer assessment i...Show More
Gabriel Badea received the B.Sc. degree in computer science and the M.Sc. degree in information systems for e-business in 2016 and 2018, respectively, from the University of Craiova, Craiova, Romania, where he is currently working toward the Ph.D. degree.
He has been a Teaching Assistant with the University of Craiova since 2018. His major research interests are related to technology enhanced learning and peer assessment i...View more
Author image of Elvira Popescu
Computers and Information Technology Department, University of Craiova, Craiova, Romania
Elvira Popescu (Senior Member, IEEE) received the Ph.D. degree in information and systems technologies from the University of Technology of Compiègne, Compiègne, France and the University of Craiova, Craiova, Romania (double degree), in 2009.
She has been a Faculty Member with the Computers and Information Technology Department, University of Craiova, since 2005, obtaining the position of Full Professor in 2018. She author...Show More
Elvira Popescu (Senior Member, IEEE) received the Ph.D. degree in information and systems technologies from the University of Technology of Compiègne, Compiègne, France and the University of Craiova, Craiova, Romania (double degree), in 2009.
She has been a Faculty Member with the Computers and Information Technology Department, University of Craiova, since 2005, obtaining the position of Full Professor in 2018. She author...View more

Author image of Gabriel Badea
Computers and Information Technology Department, University of Craiova, Craiova, Romania
Gabriel Badea received the B.Sc. degree in computer science and the M.Sc. degree in information systems for e-business in 2016 and 2018, respectively, from the University of Craiova, Craiova, Romania, where he is currently working toward the Ph.D. degree.
He has been a Teaching Assistant with the University of Craiova since 2018. His major research interests are related to technology enhanced learning and peer assessment in education.
Mr. Badea is the recipient of several scholarships and awards, including a distinguished paper award.
Gabriel Badea received the B.Sc. degree in computer science and the M.Sc. degree in information systems for e-business in 2016 and 2018, respectively, from the University of Craiova, Craiova, Romania, where he is currently working toward the Ph.D. degree.
He has been a Teaching Assistant with the University of Craiova since 2018. His major research interests are related to technology enhanced learning and peer assessment in education.
Mr. Badea is the recipient of several scholarships and awards, including a distinguished paper award.View more
Author image of Elvira Popescu
Computers and Information Technology Department, University of Craiova, Craiova, Romania
Elvira Popescu (Senior Member, IEEE) received the Ph.D. degree in information and systems technologies from the University of Technology of Compiègne, Compiègne, France and the University of Craiova, Craiova, Romania (double degree), in 2009.
She has been a Faculty Member with the Computers and Information Technology Department, University of Craiova, since 2005, obtaining the position of Full Professor in 2018. She authored and coauthored more than 100 publications, including two books, journal articles, book chapters, and conference papers. In addition, she coedited six journal special issues as well as 18 international conference proceedings. She participated in more than 15 national and international research projects, three of which as Principal Investigator (grant director). Her research interests include technology enhanced learning, adaptation and personalization in web-based systems, learner modeling, computer-supported collaborative learning, learning analytics, and intelligent and distributed computing.
Dr. Popescu is the recipient of several scholarships and awards, including five best paper distinctions. She is actively involved in the research community by serving as Associate Editor for three journals, member of five other journal editorial boards, organizing a series of international workshops in the area of social and personal computing for e-learning (SPeL 2008−2020), and acting as conference chair, program committee chair, and track chair for more than 20 conferences. She currently serves as the Vice Chair for the IEEE Women in Engineering Romania Section Affinity Group and is a board member for the IEEE Technical Committee on Learning Technology (TCLT) and the International Association of Smart Learning Environments (IASLE). She is also a Distinguished Speaker in the IEEE Computer Society Distinguished Visitors Program.
Elvira Popescu (Senior Member, IEEE) received the Ph.D. degree in information and systems technologies from the University of Technology of Compiègne, Compiègne, France and the University of Craiova, Craiova, Romania (double degree), in 2009.
She has been a Faculty Member with the Computers and Information Technology Department, University of Craiova, since 2005, obtaining the position of Full Professor in 2018. She authored and coauthored more than 100 publications, including two books, journal articles, book chapters, and conference papers. In addition, she coedited six journal special issues as well as 18 international conference proceedings. She participated in more than 15 national and international research projects, three of which as Principal Investigator (grant director). Her research interests include technology enhanced learning, adaptation and personalization in web-based systems, learner modeling, computer-supported collaborative learning, learning analytics, and intelligent and distributed computing.
Dr. Popescu is the recipient of several scholarships and awards, including five best paper distinctions. She is actively involved in the research community by serving as Associate Editor for three journals, member of five other journal editorial boards, organizing a series of international workshops in the area of social and personal computing for e-learning (SPeL 2008−2020), and acting as conference chair, program committee chair, and track chair for more than 20 conferences. She currently serves as the Vice Chair for the IEEE Women in Engineering Romania Section Affinity Group and is a board member for the IEEE Technical Committee on Learning Technology (TCLT) and the International Association of Smart Learning Environments (IASLE). She is also a Distinguished Speaker in the IEEE Computer Society Distinguished Visitors Program.View more
Contact IEEE to Subscribe

References

References is not available for this document.