Abstract:
Recent research shows that learners who are able to self-regulate their learning show greater levels of engagement with massive open online course (MOOC) content. To impr...Show MoreMetadata
Abstract:
Recent research shows that learners who are able to self-regulate their learning show greater levels of engagement with massive open online course (MOOC) content. To improve support for learners in their self-regulatory processes, researchers have proposed technological solutions to transform recorded MOOC data into actionable knowledge. However, studies providing empirical evidence on how these solutions impact learners' engagement with the course and their self-regulatory behavior remain scarce. In this article, we present the results of an observational case study in which NoteMyProgress (NMP), a web-based tool designed to support learners' self-regulation in MOOCs, is applied as an intervention in two MOOCs. The main aim of this article is to provide insights into how the support of learners' self-regulated learning (SRL) strategies correlates with course engagement. We performed the evaluation using a sample of 263 learners and utilized distinct data sources in order to propose indicators for learners' engagement with the course and NMP. Results show a positive correlation between learners' final grades with NMP functionalities that support goal setting, organization (note taking), and self-reflection (social comparison) SRL strategies. Furthermore, we found no significant behavioral differences in how learners with low SRL and high SRL profiles engage with the course or NMP. Finally, we discuss how these results relate to prior work and the implications for future technological solutions that seek to promote engagement in MOOCs.
Published in: IEEE Transactions on Learning Technologies ( Volume: 13, Issue: 4, 01 Oct.-Dec. 2020)
Funding Agency:
Department of Business Computer Science, Universidad de Costa Rica, Puntarenas, Costa Rica
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Ronald Antonio Pérez Álvarez received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, Santiago, Chile, in 2020.
He is currently an Adjunct Professor and Researcher with the Universidad de Costa Rica, Costa Rica. His research interests include massive open online courses (MOOCs), self-regulation of learning, dashboard design and implementation to support self-regulation of learning in...Show More
Ronald Antonio Pérez Álvarez received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, Santiago, Chile, in 2020.
He is currently an Adjunct Professor and Researcher with the Universidad de Costa Rica, Costa Rica. His research interests include massive open online courses (MOOCs), self-regulation of learning, dashboard design and implementation to support self-regulation of learning in...View more
Computer Science Department, Universidad de Cuenca, Cuenca, Ecuador
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Jorge Maldonado-Mahauad received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, in 2019.
He is currently an Adjunct Professor with the Universidad de Cuenca, Ecuador, and the Coordinator of the Learning Analytics Community, Latin America. He has directed projects at an institutional and national level in Ecuador related to the use of computer technologies in the classroom and has pa...Show More
Jorge Maldonado-Mahauad received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, in 2019.
He is currently an Adjunct Professor with the Universidad de Cuenca, Ecuador, and the Coordinator of the Learning Analytics Community, Latin America. He has directed projects at an institutional and national level in Ecuador related to the use of computer technologies in the classroom and has pa...View more
Norwegian University of Science and Technology, Trondheim, Norway
Kshitij Sharma received the Ph.D. in computer science from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2015.
He is currently a Postdoctoral Researcher with the CHILI Lab, EPFL, and with the Faculty of Business and Economics (HEC), University of Lausanne, Switzerland. He has authored more than 25 academic publications on these topics. His background is in the area of human–computer interac...Show More
Kshitij Sharma received the Ph.D. in computer science from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2015.
He is currently a Postdoctoral Researcher with the CHILI Lab, EPFL, and with the Faculty of Business and Economics (HEC), University of Lausanne, Switzerland. He has authored more than 25 academic publications on these topics. His background is in the area of human–computer interac...View more
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Diego Sapunar-Opazo is currently working toward the master's degree with the School of Engineering, Pontificia Universidad Católica de Chile.
In 2019, he worked as a Research Intern at the Intelligent Data Exploration and Analysis Lab, University of Texas at Austin, Austin, TX, USA, and in 2018, he was a Visiting Scholar at the Sutardja Center for Entrepreneurship and Technology, University of California, Berkeley, CA, USA...Show More
Diego Sapunar-Opazo is currently working toward the master's degree with the School of Engineering, Pontificia Universidad Católica de Chile.
In 2019, he worked as a Research Intern at the Intelligent Data Exploration and Analysis Lab, University of Texas at Austin, Austin, TX, USA, and in 2018, he was a Visiting Scholar at the Sutardja Center for Entrepreneurship and Technology, University of California, Berkeley, CA, USA...View more
Institute de Recherce Informatique de Toulouse, Université Paul Sabatier Toulouse III, Toulouse, France
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Mar Pérez-Sanagustín received the Ph.D. degree in information and communication technologies from the Universidat Pompeu Fabra, Barcelona, in 2011, obtaining the cum laude grade with European Mention.
She is currently an Associate Professor with the Universite Paul Sabatier Toulouse III and the Laboratory IRIT, as well as an Associate Researcher with the Pontificia Universidad Católica de Chile. From 2011 to 2014, she work...Show More
Mar Pérez-Sanagustín received the Ph.D. degree in information and communication technologies from the Universidat Pompeu Fabra, Barcelona, in 2011, obtaining the cum laude grade with European Mention.
She is currently an Associate Professor with the Universite Paul Sabatier Toulouse III and the Laboratory IRIT, as well as an Associate Researcher with the Pontificia Universidad Católica de Chile. From 2011 to 2014, she work...View more
Contents Department of Business Computer Science, Universidad de Costa Rica, Puntarenas, Costa Rica
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Ronald Antonio Pérez Álvarez received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, Santiago, Chile, in 2020.
He is currently an Adjunct Professor and Researcher with the Universidad de Costa Rica, Costa Rica. His research interests include massive open online courses (MOOCs), self-regulation of learning, dashboard design and implementation to support self-regulation of learning in MOOCs, and analysis of learning in online learning environments. As part of his research work, he has designed and implemented a dashboard for learning analytics, called NoteMyProgress, which supports learners’ self-regulation strategies in MOOCs.
Ronald Antonio Pérez Álvarez received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, Santiago, Chile, in 2020.
He is currently an Adjunct Professor and Researcher with the Universidad de Costa Rica, Costa Rica. His research interests include massive open online courses (MOOCs), self-regulation of learning, dashboard design and implementation to support self-regulation of learning in MOOCs, and analysis of learning in online learning environments. As part of his research work, he has designed and implemented a dashboard for learning analytics, called NoteMyProgress, which supports learners’ self-regulation strategies in MOOCs.View more
Computer Science Department, Universidad de Cuenca, Cuenca, Ecuador
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Jorge Maldonado-Mahauad received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, in 2019.
He is currently an Adjunct Professor with the Universidad de Cuenca, Ecuador, and the Coordinator of the Learning Analytics Community, Latin America. He has directed projects at an institutional and national level in Ecuador related to the use of computer technologies in the classroom and has participated as a Researcher in the international projects Erasmus + MOOC Maker, Erasmus + LALA, and Fondecyt- Chile. His research interests include MOOC, self-regulated learning, blended learning, process mining, and learning analytics.
Jorge Maldonado-Mahauad received the Ph.D. degree in computer science from the Pontificia Universidad Católica de Chile, in 2019.
He is currently an Adjunct Professor with the Universidad de Cuenca, Ecuador, and the Coordinator of the Learning Analytics Community, Latin America. He has directed projects at an institutional and national level in Ecuador related to the use of computer technologies in the classroom and has participated as a Researcher in the international projects Erasmus + MOOC Maker, Erasmus + LALA, and Fondecyt- Chile. His research interests include MOOC, self-regulated learning, blended learning, process mining, and learning analytics.View more
Norwegian University of Science and Technology, Trondheim, Norway
Kshitij Sharma received the Ph.D. in computer science from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2015.
He is currently a Postdoctoral Researcher with the CHILI Lab, EPFL, and with the Faculty of Business and Economics (HEC), University of Lausanne, Switzerland. He has authored more than 25 academic publications on these topics. His background is in the area of human–computer interaction (HCI) and collaborative/cooperative learning. He seeks to understand relations between user data (eye-tracking, system log data, and user actions) and the profile of the user (expertise, motivation, strategy, and performance) based on empirical experimentation (controlled experiments) and mixed methods analysis (utilizing a multitude of digital technologies). His research interests are primarily in the area of applied machine learning and HCI with a strong emphasis on group behavior and physiological data, such as eye-tracking, electroencephalography (EEG), and facial expressions (theoretical and practical methods in digital interaction). His research interests include eye-tracking, MOOCs, collaborative learning, Big Data analysis, and statistics.
Kshitij Sharma received the Ph.D. in computer science from the École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland, in 2015.
He is currently a Postdoctoral Researcher with the CHILI Lab, EPFL, and with the Faculty of Business and Economics (HEC), University of Lausanne, Switzerland. He has authored more than 25 academic publications on these topics. His background is in the area of human–computer interaction (HCI) and collaborative/cooperative learning. He seeks to understand relations between user data (eye-tracking, system log data, and user actions) and the profile of the user (expertise, motivation, strategy, and performance) based on empirical experimentation (controlled experiments) and mixed methods analysis (utilizing a multitude of digital technologies). His research interests are primarily in the area of applied machine learning and HCI with a strong emphasis on group behavior and physiological data, such as eye-tracking, electroencephalography (EEG), and facial expressions (theoretical and practical methods in digital interaction). His research interests include eye-tracking, MOOCs, collaborative learning, Big Data analysis, and statistics.View more
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Diego Sapunar-Opazo is currently working toward the master's degree with the School of Engineering, Pontificia Universidad Católica de Chile.
In 2019, he worked as a Research Intern at the Intelligent Data Exploration and Analysis Lab, University of Texas at Austin, Austin, TX, USA, and in 2018, he was a Visiting Scholar at the Sutardja Center for Entrepreneurship and Technology, University of California, Berkeley, CA, USA. His research interests include the analysis of learning in massive open online courses and blended learning contexts, based on the self-regulation of learning.
Diego Sapunar-Opazo is currently working toward the master's degree with the School of Engineering, Pontificia Universidad Católica de Chile.
In 2019, he worked as a Research Intern at the Intelligent Data Exploration and Analysis Lab, University of Texas at Austin, Austin, TX, USA, and in 2018, he was a Visiting Scholar at the Sutardja Center for Entrepreneurship and Technology, University of California, Berkeley, CA, USA. His research interests include the analysis of learning in massive open online courses and blended learning contexts, based on the self-regulation of learning.View more
Institute de Recherce Informatique de Toulouse, Université Paul Sabatier Toulouse III, Toulouse, France
School of Engineering, Pontificia Universidad Católica de Chile, Santiago, Chile
Mar Pérez-Sanagustín received the Ph.D. degree in information and communication technologies from the Universidat Pompeu Fabra, Barcelona, in 2011, obtaining the cum laude grade with European Mention.
She is currently an Associate Professor with the Universite Paul Sabatier Toulouse III and the Laboratory IRIT, as well as an Associate Researcher with the Pontificia Universidad Católica de Chile. From 2011 to 2014, she worked at GAST, Universidad Carlos III de Madrid (UC3M), and as a Teacher in the Department of Telematics Engineering, where she was a Postdoctoral Fellow.
Mar Pérez-Sanagustín received the Ph.D. degree in information and communication technologies from the Universidat Pompeu Fabra, Barcelona, in 2011, obtaining the cum laude grade with European Mention.
She is currently an Associate Professor with the Universite Paul Sabatier Toulouse III and the Laboratory IRIT, as well as an Associate Researcher with the Pontificia Universidad Católica de Chile. From 2011 to 2014, she worked at GAST, Universidad Carlos III de Madrid (UC3M), and as a Teacher in the Department of Telematics Engineering, where she was a Postdoctoral Fellow.View more
