ERIC Number: EJ1362072
Record Type: Journal
Publication Date: 2023-Feb
Pages: 13
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0266-4909
EISSN: EISSN-1365-2729
The Effects of Assessment Design on Academic Dishonesty, Learner Engagement, and Certification Rates in MOOCs
Alexandron, Giora; Wiltrout, Mary Ellen; Berg, Aviram; Gershon, Sa'ar Karp; Ruipérez-Valiente, José A.
Journal of Computer Assisted Learning, v39 n1 p141-153 Feb 2023
Background: Massive Open Online Courses (MOOCs) have touted the idea of democratizing education, but soon enough, this utopian idea collided with the reality of finding sustainable business models. In addition, the promise of harnessing interactive and social web technologies to promote meaningful learning was only partially successful. And finally, studies demonstrated that many learners exploit the anonymity and feedback to earn certificates unethically. Thus, establishing MOOC pedagogical models that balance open access, meaningful learning, and trustworthy assessment remains a challenge that is crucial for the field to achieve its goals. Objectives: This study analysed the influence of an MOOC assessment model, denoted the Competency Exam (CE), on learner engagement, the level of cheating, and certification rates. At its core, this model separates learning from for-credit assessment, and it was introduced by the MITx Biology course team in 2016. Methods: We applied a learning analytics methodology to the clickstream data of the verified learners (N = 559) from four consecutive runs of an Introductory Biology MOOC offered through edX. The analysis used novel algorithms for measuring the level of cheating and learner engagement, which were developed in the previous studies. Results and Conclusions: On the positive side, the CE model reduced cheating and did not reduce learner engagement with the main learning materials -- videos and formative assessment items. On the negative side, it led to procrastination, and certification rates were lower. Implications: First, the results shed light on the fundamental connection between incentive design and learner behaviour. Second, the CE provides MOOC designers with an 'analytically verified' model to reduce cheating without compromising on open access. Third, our methodology provides a novel means for measuring cheating and learner engagement in MOOCs.
Descriptors: MOOCs, Evaluation, Models, Learner Engagement, Certification, Incidence, Cheating, Competence, Time Management, Test Construction, Graduation Rate, Minimum Competency Testing
Wiley. Available from: John Wiley & Sons, Inc. 111 River Street, Hoboken, NJ 07030. Tel: 800-835-6770; e-mail: cs-journals@wiley.com; Web site: https://bibliotheek.ehb.be:2191/en-us
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A