Abstract:
With the wide expansion of distributed learning environments the way we learn became more diverse than ever. This poses an opportunity to incorporate different data sourc...Show MoreMetadata
Abstract:
With the wide expansion of distributed learning environments the way we learn became more diverse than ever. This poses an opportunity to incorporate different data sources of learning traces that can offer broader insights into learner behavior and the intricacies of the learning process. We argue that combining analytics across different e-learning systems can potentially measure the effectiveness of learning designs and maximize learning opportunities in distributed settings. As a step toward this goal, in this study, we considered how to broaden the context of a single learning environment into a learning ecosystem that integrates three separate e-learning systems. We present a cross-platform architecture that captures, integrates, and stores learning-related data from the learning ecosystem. To demonstrate the feasibility and the benefits of cross-platform architecture, we used regression and classification techniques to generate interpretable models with analytics that can be relevant for instructors in understanding learning behavior and sensemaking of the instructional method on learner performance. The results show that combining data across three e-learning systems improve the classification accuracy compared to data from a single learning system by a factor of 5. This article highlights the value of cross-platform learning analytics and presents a springboard for the creation of new cross-system data-driven research practices.
Published in: IEEE Transactions on Learning Technologies ( Volume: 14, Issue: 2, 01 April 2021)
Funding Agency:

Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, Trondheim, Norway
Katerina Mangaroska received the Ph.D. degree in computer science from the Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway, in 2021.
Her primary research area is learning analytics and computing education research. She was part of the “Future Learning: Orchestrating 21st Century Learning Ecosystem using Analytics” project that aims to develop new knowledge based on how anal...Show More
Katerina Mangaroska received the Ph.D. degree in computer science from the Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway, in 2021.
Her primary research area is learning analytics and computing education research. She was part of the “Future Learning: Orchestrating 21st Century Learning Ecosystem using Analytics” project that aims to develop new knowledge based on how anal...View more

School of Business, University of South-Eastern Norway, Vestfold, Norway
Boban Vesin received the M.Sc. and Ph.D. degrees in computer science from the University of Novi Sad, Novi Sad, Serbia, in 2007 and 2014, respectively.
He is currently an Associate Professor with the University of South-Eastern Norway, Vestfold, Norway. He has authored or coauthored 40 scientific papers in journals and proceedings of international conferences in personalized learning, software engineering, and learning ana...Show More
Boban Vesin received the M.Sc. and Ph.D. degrees in computer science from the University of Novi Sad, Novi Sad, Serbia, in 2007 and 2014, respectively.
He is currently an Associate Professor with the University of South-Eastern Norway, Vestfold, Norway. He has authored or coauthored 40 scientific papers in journals and proceedings of international conferences in personalized learning, software engineering, and learning ana...View more

School of Computing and Information Systems, University of Melbourne, Parkville, VIC, Australia
Vassilis Kostakos received the Ph.D. degree in computer science from the University of Bath, Bath, U.K, in 2005.
He is currently a Professor of Human–Computer Interaction with the School of Computing and Information Systems, University of Melbourne, Parkville, VIC, Australia. His research interests include ubiquitous computing (Ubicomp), human–computer interaction, social computing, and Internet of Things.
Dr. Kostakos is a...Show More
Vassilis Kostakos received the Ph.D. degree in computer science from the University of Bath, Bath, U.K, in 2005.
He is currently a Professor of Human–Computer Interaction with the School of Computing and Information Systems, University of Melbourne, Parkville, VIC, Australia. His research interests include ubiquitous computing (Ubicomp), human–computer interaction, social computing, and Internet of Things.
Dr. Kostakos is a...View more

School of Information Sciences, University of Pittsburgh, Pittsburgh, PA, USA
Peter Brusilovsky (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and Ph.D. degree in computer science from Moscow Lomonosov State University, Moscow, Russia, in 1983 and 1987, respectively.
He received postdoctoral training at the University of Sussex, the University of Trier, and Carnegie Mellon University. He is currently a Professor of Information Science and Intelligent Systems with the Universi...Show More
Peter Brusilovsky (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and Ph.D. degree in computer science from Moscow Lomonosov State University, Moscow, Russia, in 1983 and 1987, respectively.
He received postdoctoral training at the University of Sussex, the University of Trier, and Carnegie Mellon University. He is currently a Professor of Information Science and Intelligent Systems with the Universi...View more

Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, Trondheim, Norway
Michail N. Giannakos (Senior Member, IEEE) received the Ph.D. degree in informatics from the Department of Informatics, Ionian University, Corfu, Greece, in 2013.
He is currently a Professor of Interaction Design and Learning Technologies with the Department of Computer Science, Norges Teknisk-Naturvitenskaplige Universitet (NTNU), Trondheim, Norway, and the Head of the Learner-Computer Interaction Laboratory.
Dr. Giannakos...Show More
Michail N. Giannakos (Senior Member, IEEE) received the Ph.D. degree in informatics from the Department of Informatics, Ionian University, Corfu, Greece, in 2013.
He is currently a Professor of Interaction Design and Learning Technologies with the Department of Computer Science, Norges Teknisk-Naturvitenskaplige Universitet (NTNU), Trondheim, Norway, and the Head of the Learner-Computer Interaction Laboratory.
Dr. Giannakos...View more

Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, Trondheim, Norway
Katerina Mangaroska received the Ph.D. degree in computer science from the Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway, in 2021.
Her primary research area is learning analytics and computing education research. She was part of the “Future Learning: Orchestrating 21st Century Learning Ecosystem using Analytics” project that aims to develop new knowledge based on how analytics allow us to better orchestrate learning tools and practices, and design optimal technology-rich distributed learning environments. Her other research interests include learning design, multimodal learning analytics, adaptive learning, eye-tracking, intelligent tutoring systems, and human–computer interaction.
Dr. Mangaroska is a Fulbright Scholar.
Katerina Mangaroska received the Ph.D. degree in computer science from the Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway, in 2021.
Her primary research area is learning analytics and computing education research. She was part of the “Future Learning: Orchestrating 21st Century Learning Ecosystem using Analytics” project that aims to develop new knowledge based on how analytics allow us to better orchestrate learning tools and practices, and design optimal technology-rich distributed learning environments. Her other research interests include learning design, multimodal learning analytics, adaptive learning, eye-tracking, intelligent tutoring systems, and human–computer interaction.
Dr. Mangaroska is a Fulbright Scholar.View more

School of Business, University of South-Eastern Norway, Vestfold, Norway
Boban Vesin received the M.Sc. and Ph.D. degrees in computer science from the University of Novi Sad, Novi Sad, Serbia, in 2007 and 2014, respectively.
He is currently an Associate Professor with the University of South-Eastern Norway, Vestfold, Norway. He has authored or coauthored 40 scientific papers in journals and proceedings of international conferences in personalized learning, software engineering, and learning analytics. His research interests include the engineering of e-learning systems, and learning analytics to help teachers understand and improve teaching processes.
Boban Vesin received the M.Sc. and Ph.D. degrees in computer science from the University of Novi Sad, Novi Sad, Serbia, in 2007 and 2014, respectively.
He is currently an Associate Professor with the University of South-Eastern Norway, Vestfold, Norway. He has authored or coauthored 40 scientific papers in journals and proceedings of international conferences in personalized learning, software engineering, and learning analytics. His research interests include the engineering of e-learning systems, and learning analytics to help teachers understand and improve teaching processes.View more

School of Computing and Information Systems, University of Melbourne, Parkville, VIC, Australia
Vassilis Kostakos received the Ph.D. degree in computer science from the University of Bath, Bath, U.K, in 2005.
He is currently a Professor of Human–Computer Interaction with the School of Computing and Information Systems, University of Melbourne, Parkville, VIC, Australia. His research interests include ubiquitous computing (Ubicomp), human–computer interaction, social computing, and Internet of Things.
Dr. Kostakos is a Marie Curie Fellow, a Fellow in the Academy of Finland Distinguished Professor Program, and a Founding Editor of the Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.
Vassilis Kostakos received the Ph.D. degree in computer science from the University of Bath, Bath, U.K, in 2005.
He is currently a Professor of Human–Computer Interaction with the School of Computing and Information Systems, University of Melbourne, Parkville, VIC, Australia. His research interests include ubiquitous computing (Ubicomp), human–computer interaction, social computing, and Internet of Things.
Dr. Kostakos is a Marie Curie Fellow, a Fellow in the Academy of Finland Distinguished Professor Program, and a Founding Editor of the Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies.View more

School of Information Sciences, University of Pittsburgh, Pittsburgh, PA, USA
Peter Brusilovsky (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and Ph.D. degree in computer science from Moscow Lomonosov State University, Moscow, Russia, in 1983 and 1987, respectively.
He received postdoctoral training at the University of Sussex, the University of Trier, and Carnegie Mellon University. He is currently a Professor of Information Science and Intelligent Systems with the University of Pittsburgh, Pittsburgh, PA, USA, where he directs the Personalized Adaptive Web Systems Laboratory. He has been involved in the field of adaptive educational systems, user modeling, and intelligent user interfaces for more than 20 years. He has authored or coauthored numerous papers and edited several books on adaptive hypermedia, adaptive educational systems, user modeling, and the adaptive Web.
Peter Brusilovsky (Senior Member, IEEE) received the M.Sc. degree in applied mathematics and Ph.D. degree in computer science from Moscow Lomonosov State University, Moscow, Russia, in 1983 and 1987, respectively.
He received postdoctoral training at the University of Sussex, the University of Trier, and Carnegie Mellon University. He is currently a Professor of Information Science and Intelligent Systems with the University of Pittsburgh, Pittsburgh, PA, USA, where he directs the Personalized Adaptive Web Systems Laboratory. He has been involved in the field of adaptive educational systems, user modeling, and intelligent user interfaces for more than 20 years. He has authored or coauthored numerous papers and edited several books on adaptive hypermedia, adaptive educational systems, user modeling, and the adaptive Web.View more

Department of Computer Science, Faculty of Information Technology and Electrical Engineering, Norwegian University of Science and Technology, Trondheim, Norway
Michail N. Giannakos (Senior Member, IEEE) received the Ph.D. degree in informatics from the Department of Informatics, Ionian University, Corfu, Greece, in 2013.
He is currently a Professor of Interaction Design and Learning Technologies with the Department of Computer Science, Norges Teknisk-Naturvitenskaplige Universitet (NTNU), Trondheim, Norway, and the Head of the Learner-Computer Interaction Laboratory.
Dr. Giannakos is currently an Associate Editor and/or Guest Editor for highly recognized journals, such as IEEE Transactions on Learning Technologies, British Journal of Educational Technology, Computers in Human Behavior, IEEE Transactions on Education, and ACM Transactions on Computing Education. He is also one of the outstanding academic fellows of NTNU (2017–2021).
Michail N. Giannakos (Senior Member, IEEE) received the Ph.D. degree in informatics from the Department of Informatics, Ionian University, Corfu, Greece, in 2013.
He is currently a Professor of Interaction Design and Learning Technologies with the Department of Computer Science, Norges Teknisk-Naturvitenskaplige Universitet (NTNU), Trondheim, Norway, and the Head of the Learner-Computer Interaction Laboratory.
Dr. Giannakos is currently an Associate Editor and/or Guest Editor for highly recognized journals, such as IEEE Transactions on Learning Technologies, British Journal of Educational Technology, Computers in Human Behavior, IEEE Transactions on Education, and ACM Transactions on Computing Education. He is also one of the outstanding academic fellows of NTNU (2017–2021).View more