Abstract:
Accurately grading open-ended assignmentsin large or massive open online courses is nontrivial. Peer review is a promising solution but can be unreliable due to few revie...Show MoreMetadata
Abstract:
Accurately grading open-ended assignmentsin large or massive open online courses is nontrivial. Peer review is a promising solution but can be unreliable due to few reviewers and an unevaluated review form. To date, no work has leveraged sentiment analysis in the peer-review process to inform or validate grades or utilized aspect extraction to craft a review form from what students actually communicated. This article utilizes, rather than discards, student data from review form comments to deliver better information to the instructor. In this article, we detail the process by which we create our domain-dependent lexicon and aspect-informed review form as well as our entire sentiment analysis algorithm, which provides a fine-grained sentiment score from text alone. We end by analyzing validity and discussing conclusions from our corpus of over 6800 peer reviews from nine courses to understand the viability of sentiment in the classroom for increasing the information from and reliability of grading open-ended assignments in large courses.
Published in: IEEE Transactions on Learning Technologies ( Volume: 14, Issue: 4, 01 August 2021)
Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
Zachariah J. Beasley received the Ph.D. degree in computer science and engineering (with a focus on sentiment analysis in peer review) from the University of South Florida (USF), Tampa, FL, USA, in 2020.
In August 2020, he joined USF, where he is currently a USF STEER STEM Scholar.
Dr. Beasley is the recipient of the ASEE State of Engineering Education in 25 Years Award and the USF Spirit of Innovation Award.
Zachariah J. Beasley received the Ph.D. degree in computer science and engineering (with a focus on sentiment analysis in peer review) from the University of South Florida (USF), Tampa, FL, USA, in 2020.
In August 2020, he joined USF, where he is currently a USF STEER STEM Scholar.
Dr. Beasley is the recipient of the ASEE State of Engineering Education in 25 Years Award and the USF Spirit of Innovation Award.View more
Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
Les A. Piegl received the Ph.D. degree in applied computing from Eotvos University, Budapest, Hungary, in 1983, where his dissertation was on computer graphics and computational geometry. He is currently a Professor of Computer Science and Engineering with the University of South Florida, Tampa, FL, USA, where he directs the CAD and Visualization Laboratory.
He has been an Alexander von Humboldt Research Fellow at the Tech...Show More
Les A. Piegl received the Ph.D. degree in applied computing from Eotvos University, Budapest, Hungary, in 1983, where his dissertation was on computer graphics and computational geometry. He is currently a Professor of Computer Science and Engineering with the University of South Florida, Tampa, FL, USA, where he directs the CAD and Visualization Laboratory.
He has been an Alexander von Humboldt Research Fellow at the Tech...View more
Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
Paul Rosen (Member, IEEE) received the Ph.D. degree in computer science from Purdue University, West Lafayette, IN, USA, in 2010.
His Ph.D. dissertation was about camera model design, a problem-solving paradigm that advocates designing dynamic, application-specific camera models for solving problems in computer graphics, visualization, and computer vision. While at Purdue University, he was a key participant of the team, w...Show More
Paul Rosen (Member, IEEE) received the Ph.D. degree in computer science from Purdue University, West Lafayette, IN, USA, in 2010.
His Ph.D. dissertation was about camera model design, a problem-solving paradigm that advocates designing dynamic, application-specific camera models for solving problems in computer graphics, visualization, and computer vision. While at Purdue University, he was a key participant of the team, w...View more
Contents Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
Zachariah J. Beasley received the Ph.D. degree in computer science and engineering (with a focus on sentiment analysis in peer review) from the University of South Florida (USF), Tampa, FL, USA, in 2020.
In August 2020, he joined USF, where he is currently a USF STEER STEM Scholar.
Dr. Beasley is the recipient of the ASEE State of Engineering Education in 25 Years Award and the USF Spirit of Innovation Award.
Zachariah J. Beasley received the Ph.D. degree in computer science and engineering (with a focus on sentiment analysis in peer review) from the University of South Florida (USF), Tampa, FL, USA, in 2020.
In August 2020, he joined USF, where he is currently a USF STEER STEM Scholar.
Dr. Beasley is the recipient of the ASEE State of Engineering Education in 25 Years Award and the USF Spirit of Innovation Award.View more
Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
Les A. Piegl received the Ph.D. degree in applied computing from Eotvos University, Budapest, Hungary, in 1983, where his dissertation was on computer graphics and computational geometry. He is currently a Professor of Computer Science and Engineering with the University of South Florida, Tampa, FL, USA, where he directs the CAD and Visualization Laboratory.
He has been an Alexander von Humboldt Research Fellow at the Technical University of Braunschweig, Braunschweig, Germany, a William Mong Fellow at the University of Hong Kong, Hong Kong, and a Visiting Professor of Manufacturing Engineering at the City University of Hong Kong, Hong Kong. He is the co-author of the standard text The NURBS Book Springer-Verlag, 1995) and the developer of a number of commercial B-spline kernels. His current research interests include 3-D printing, shape modeling, and cyber learning.
Prof. Piegl is the past Editor-in-Chief of Computer-Aided Design, the current Founding Editor-in-Chief of Computer-Aided Design and Applications, and the Founder and General Chair of the Annual CAD Conference.
Les A. Piegl received the Ph.D. degree in applied computing from Eotvos University, Budapest, Hungary, in 1983, where his dissertation was on computer graphics and computational geometry. He is currently a Professor of Computer Science and Engineering with the University of South Florida, Tampa, FL, USA, where he directs the CAD and Visualization Laboratory.
He has been an Alexander von Humboldt Research Fellow at the Technical University of Braunschweig, Braunschweig, Germany, a William Mong Fellow at the University of Hong Kong, Hong Kong, and a Visiting Professor of Manufacturing Engineering at the City University of Hong Kong, Hong Kong. He is the co-author of the standard text The NURBS Book Springer-Verlag, 1995) and the developer of a number of commercial B-spline kernels. His current research interests include 3-D printing, shape modeling, and cyber learning.
Prof. Piegl is the past Editor-in-Chief of Computer-Aided Design, the current Founding Editor-in-Chief of Computer-Aided Design and Applications, and the Founder and General Chair of the Annual CAD Conference.View more
Department of Computer Science and Engineering, University of South Florida, Tampa, FL, USA
Paul Rosen (Member, IEEE) received the Ph.D. degree in computer science from Purdue University, West Lafayette, IN, USA, in 2010.
His Ph.D. dissertation was about camera model design, a problem-solving paradigm that advocates designing dynamic, application-specific camera models for solving problems in computer graphics, visualization, and computer vision. While at Purdue University, he was a key participant of the team, which modeled, simulated, and visualized the September 11, 2001 attack on the World Trade Center North Tower. The press release from the simulation resulted the most widely covered in Purdue University history, with the associated video appearing on many news and educational television programs. The video has been viewed almost 15 million times on YouTube. After Purdue, he joined the University of Utah, Salt Lake City, UT, USA, as a Research Assistant Professor with the Scientific Computing and Imaging Institute and the School of Computing. At the University of Utah, his research focused more toward scientific and information visualization approaches. Since August 2015, he has been with the University of South Florida, Tampa, FL, USA.
Paul Rosen (Member, IEEE) received the Ph.D. degree in computer science from Purdue University, West Lafayette, IN, USA, in 2010.
His Ph.D. dissertation was about camera model design, a problem-solving paradigm that advocates designing dynamic, application-specific camera models for solving problems in computer graphics, visualization, and computer vision. While at Purdue University, he was a key participant of the team, which modeled, simulated, and visualized the September 11, 2001 attack on the World Trade Center North Tower. The press release from the simulation resulted the most widely covered in Purdue University history, with the associated video appearing on many news and educational television programs. The video has been viewed almost 15 million times on YouTube. After Purdue, he joined the University of Utah, Salt Lake City, UT, USA, as a Research Assistant Professor with the Scientific Computing and Imaging Institute and the School of Computing. At the University of Utah, his research focused more toward scientific and information visualization approaches. Since August 2015, he has been with the University of South Florida, Tampa, FL, USA.View more
