Loading [a11y]/accessibility-menu.js
A Three-Year Study on Peer Evaluation in a Software Engineering Project Course | IEEE Journals & Magazine | IEEE Xplore

A Three-Year Study on Peer Evaluation in a Software Engineering Project Course


Abstract:

Background: Peer evaluation in software engineering (SE) project courses enhances the learning experience of students. It also helps instructors monitor and assess both t...Show More

Abstract:

Background: Peer evaluation in software engineering (SE) project courses enhances the learning experience of students. It also helps instructors monitor and assess both teams and individual students. Peer evaluations might influence the way individual students and teams work; therefore, the quality of the peer evaluations should be tracked through the project course. Contribution: In this article, we analyzed the quality and scoring behavior of students in peer evaluation in an undergraduate SE project course over three years. Research Questions: RQ1: What is the quality of peer evaluation of undergraduate students in a SE project course? RQ2: How do undergraduate students in an SE project course score each other? Methodology: The quality of peer evaluation (length, level of detail, etc.) and scoring of peers based on various aspects of peer evaluations of third-year students in a year-long SE project course were studied. Taking into account the grade students received at the end of the course (A, B, C, and F-calibers), peer evaluations were categorized, analyzed over time, and compared between students calibers. Findings: After analyzing 6854 peer evaluations from 193 students, it was found that the quality of peer evaluations across students was mostly consistent throughout the course. Also, it was observed that quantitative aspects of the peer evaluation were scored similarly across student calibers. However, the qualitative aspects of the peer evaluation were impacted by the caliber of students. These findings suggest that weaker students (i.e., C-caliber students) generally receive better quality peer evaluations than stronger students (i.e., A-caliber students). Finally, a preliminary analysis showed a positive connotation of emotions and sentiments found in the textual feedback delivered by students.
Published in: IEEE Transactions on Education ( Volume: 65, Issue: 3, August 2022)
Page(s): 409 - 418
Date of Publication: 12 November 2021

ISSN Information:

Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Miguel Ehécatl Morales-Trujillo is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main research area is software quality, software processes, and gamification in software engineering education.
Miguel Ehécatl Morales-Trujillo is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main research area is software quality, software processes, and gamification in software engineering education.View more
Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Matthias Galster is an Associate Professor with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand.
Matthias Galster is an Associate Professor with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand.View more
Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Fabian Gilson is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His research includes model-driven engineering and natural language processing applied to software engineering.
Fabian Gilson is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His research includes model-driven engineering and natural language processing applied to software engineering.View more
Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Moffat Mathews is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main area of research is in intelligent tutoring systems and the use of those concepts in education and rehabilitation.
Moffat Mathews is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main area of research is in intelligent tutoring systems and the use of those concepts in education and rehabilitation.View more

Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Miguel Ehécatl Morales-Trujillo is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main research area is software quality, software processes, and gamification in software engineering education.
Miguel Ehécatl Morales-Trujillo is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main research area is software quality, software processes, and gamification in software engineering education.View more
Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Matthias Galster is an Associate Professor with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand.
Matthias Galster is an Associate Professor with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand.View more
Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Fabian Gilson is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His research includes model-driven engineering and natural language processing applied to software engineering.
Fabian Gilson is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His research includes model-driven engineering and natural language processing applied to software engineering.View more
Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand
Moffat Mathews is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main area of research is in intelligent tutoring systems and the use of those concepts in education and rehabilitation.
Moffat Mathews is a Senior Lecturer with the Department of Computer Science and Software Engineering, University of Canterbury, Christchurch, New Zealand. His main area of research is in intelligent tutoring systems and the use of those concepts in education and rehabilitation.View more

References

References is not available for this document.