Abstract:
Accurately grading open-ended assignmentsin large or massive open online courses is nontrivial. Peer review is a promising solution but can be unreliable due to few revie...Show MoreMetadata
Abstract:
Accurately grading open-ended assignmentsin large or massive open online courses is nontrivial. Peer review is a promising solution but can be unreliable due to few reviewers and an unevaluated review form. To date, no work has leveraged sentiment analysis in the peer-review process to inform or validate grades or utilized aspect extraction to craft a review form from what students actually communicated. This article utilizes, rather than discards, student data from review form comments to deliver better information to the instructor. In this article, we detail the process by which we create our domain-dependent lexicon and aspect-informed review form as well as our entire sentiment analysis algorithm, which provides a fine-grained sentiment score from text alone. We end by analyzing validity and discussing conclusions from our corpus of over 6800 peer reviews from nine courses to understand the viability of sentiment in the classroom for increasing the information from and reliability of grading open-ended assignments in large courses.
Published in: IEEE Transactions on Learning Technologies ( Volume: 14, Issue: 4, 01 August 2021)
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Scalability Assessment ,
- Peer Review ,
- Online Courses ,
- Sentiment Analysis ,
- Peer Review Process ,
- Massive Open Online Courses ,
- Open Online Courses ,
- Massive Open Online ,
- Large Online ,
- Sentiment Scores ,
- Social Media ,
- Reviewer Comments ,
- F1 Score ,
- Transfer Learning ,
- Geometric Model ,
- Number Of Reviews ,
- Unlabeled Data ,
- Negative Words ,
- Negative Sentiment ,
- Positive Sentiment ,
- Sentiment Words ,
- Negative Reviews ,
- Subjective Feedback ,
- Modal Verbs ,
- Grading Scheme ,
- Lexicon-based Approach ,
- Student Review ,
- Number Of Keywords ,
- Lemmatization ,
- Wisdom Of The Crowd
- Author Keywords
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Scalability Assessment ,
- Peer Review ,
- Online Courses ,
- Sentiment Analysis ,
- Peer Review Process ,
- Massive Open Online Courses ,
- Open Online Courses ,
- Massive Open Online ,
- Large Online ,
- Sentiment Scores ,
- Social Media ,
- Reviewer Comments ,
- F1 Score ,
- Transfer Learning ,
- Geometric Model ,
- Number Of Reviews ,
- Unlabeled Data ,
- Negative Words ,
- Negative Sentiment ,
- Positive Sentiment ,
- Sentiment Words ,
- Negative Reviews ,
- Subjective Feedback ,
- Modal Verbs ,
- Grading Scheme ,
- Lexicon-based Approach ,
- Student Review ,
- Number Of Keywords ,
- Lemmatization ,
- Wisdom Of The Crowd
- Author Keywords